Jul 07 22:24:13 devstack cinder-volume[76502]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:24:13 devstack cinder-volume[76502]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:24:13 devstack cinder-volume[76502]: we strongly recommend against using it for new projects. Jul 07 22:24:13 devstack cinder-volume[76502]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:24:13 devstack cinder-volume[76502]: framework. For more detail see Jul 07 22:24:13 devstack cinder-volume[76502]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:24:13 devstack cinder-volume[76502]: import eventlet # noqa Jul 07 22:24:15 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:24:15 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:24:15 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:24:16 devstack cinder-volume[76502]: INFO dbcounter [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Registered counter for database cinder Jul 07 22:24:16 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:24:17 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writer thread running {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:24:17 devstack cinder-volume[76502]: INFO cinder.rpc [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:24:17 devstack cinder-volume[76502]: INFO cinder.rpc [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:24:17 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:24:17 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Determined volume DB was empty at startup. Jul 07 22:24:17 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76502) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:24:17 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 22:24:17 devstack cinder-volume[76502]: WARNING stevedore.named [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:24:17 devstack cinder-volume[76502]: WARNING castellan.key_manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:24:17 devstack cinder-volume[76502]: WARNING cinder.keymgr.conf_key_mgr [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:24:17 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76502) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 22:24:17 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] CMD "cinder-rtstool verify" returned: 0 in 0.548s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:24:18 devstack cinder-volume[76502]: INFO cinder.rpc [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 22:24:18 devstack cinder-volume[76502]: INFO cinder.rpc [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 22:24:18 devstack cinder-volume[76502]: WARNING stevedore.named [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:24:18 devstack cinder-volume[76502]: WARNING castellan.key_manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:24:18 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:24:18 devstack cinder-volume[76502]: INFO oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Starting 1 workers Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Started child 76671 {{(pid=76502) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Full set of CONF: {{(pid=76502) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] ******************************************************************************** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Configuration options gathered from: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] ================================================================================ {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] allow_availability_zone_fallback = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] allow_compression_on_image_upload = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] allowed_direct_url_schemes = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] api_rate_limit = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] auth_strategy = keystone {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] az_cache_duration = 3600 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_availability_zone = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_host = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_stats_polling_interval = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backup_api_class = cinder.backup.api.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backup_name_template = backup-%s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backup_use_same_host = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backup_use_temp_snapshot = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] chap_password = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] chap_username = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_internal_tenant_project_id = 91709c9ad09f4b899ad8acf1efd3d649 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_internal_tenant_user_id = 488847c54ed941faa7b420d65ec245e5 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cloned_volume_same_az = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cluster = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] compression_format = gzip {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] compute_api_class = cinder.compute.nova.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] config_dir = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] config_source = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] control_exchange = openstack {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] debug = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] default_availability_zone = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] default_group_type = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] default_volume_type = lvmdriver-1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] disk_geometry = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_client_cert = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_client_cert_key = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_data_namespace = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_ssl_cert_path = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_ssl_cert_verify = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] driver_use_ssl = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] enable_force_upload = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] enable_new_services = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] enable_unsupported_driver = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] enabled_backends = ['lvmdriver-1'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] enforce_multipath_for_image_xfer = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] filter_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_api_insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_api_ssl_compression = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_ca_certificates_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_catalog_info = image:glance:publicURL {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_num_retries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance_request_timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] goodness_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] graceful_shutdown_timeout = 5 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] group_api_class = cinder.group.api.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] host = devstack {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_compress_on_upload = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_conversion_address_space_limit = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_conversion_cpu_limit = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_conversion_disable = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_upload_use_cinder_backend = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_upload_use_internal_tenant = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_volume_cache_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_volume_cache_max_count = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] image_volume_cache_max_size_gb = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] init_host_max_objects_retrieval = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] instance_format = [instance: %(uuid)s] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iscsi_target_flags = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iscsi_write_cache = on {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: INFO cinder.volume.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iser_helper = tgtadm {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iser_ip_address = 192.168.122.119 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iser_port = 3260 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_color = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_config_append = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_dir = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_options = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_rotate_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_rotate_interval_type = days {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] log_rotation_type = none {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] max_age = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] max_logfile_count = 30 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] max_logfile_size_mb = 200 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] max_over_subscription_ratio = 20.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] message_reap_interval = 86400 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] message_ttl = 2592000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] migration_create_volume_timeout_secs = 300 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] monkey_patch = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] monkey_patch_modules = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] my_ip = 192.168.122.119 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] no_snapshot_gb_quota = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] num_iser_scan_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] num_shell_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] num_volume_device_scan_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] nvmeof_conn_info_version = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] nvmet_ns_id = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] nvmet_port_id = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_max_limit = 1000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_ext_list = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_listen = 0.0.0.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_listen_port = 8776 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_use_ssl = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] osapi_volume_workers = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] per_volume_size_limit = -1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] periodic_fuzzy_delay = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] periodic_interval = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] project_id_regex = [0-9a-f\-]+ {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] public_endpoint = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] publish_errors = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_backup_gigabytes = 1000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_backups = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_gigabytes = 1000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_groups = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_snapshots = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] quota_volumes = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] rate_limit_burst = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] rate_limit_except_level = CRITICAL {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] rate_limit_interval = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] reinit_driver_count = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] replication_device = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] report_discard_supported = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] report_interval = 120 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] reservation_clean_interval = 86400 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] reservation_expire = 86400 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] reserved_image_namespaces = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] reserved_percentage = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] rpc_response_timeout = 120 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] run_external_periodic_tasks = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] scst_target_driver = iscsi {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] scst_target_iqn_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_down_time = 720 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] shell_completion = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] snapshot_name_template = snapshot-%s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] snapshot_same_host = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] split_loggers = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] state_path = /opt/stack/data/cinder {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] storage_availability_zone = nova {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] storage_protocol = iSCSI {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] syslog_log_facility = LOG_USER {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_helper = lioadm {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_ip_address = 192.168.122.119 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_port = 3260 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_protocol = iscsi {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] target_secondary_ip_addresses = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] trace_flags = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] transfer_api_class = cinder.transfer.api.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] transport_url = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] until_refresh = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_chap_auth = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_default_quota_class = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_journal = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_json = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_multipath_for_image_xfer = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_stderr = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] use_syslog = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] verify_glance_signatures = enabled {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_api_class = cinder.volume.api.API {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_backend_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_clear = zero {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_clear_ionice = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_clear_size = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_copy_bps_limit = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_dd_blocksize = 1M {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_name_template = volume-%s {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_service_inithost_offload = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volume_usage_audit_period = month {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] zoning_mode = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_concurrency.disable_process_locking = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.auth_section = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.auth_type = password {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.auth_version = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.cache = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.delay_auth_decision = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.http_connect_timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.include_service_catalog = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.interface = public {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_password = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcache_username = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.region_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.service_token_roles_required = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.service_type = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack sudo[76676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 22:24:18 devstack sudo[76676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.token_cache_time = 300 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.backend = dogpile.cache.null {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.backend_argument = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.backend_expiration_time = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.config_prefix = cache.oslo {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.debug_cache_backend = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.enable_retry_client = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.enable_socket_keepalive = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.expiration_time = 600 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.hashclient_retry_attempts = 2 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_dead_retry = 300 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_pool_maxsize = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_sasl_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.password = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.proxies = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.redis_db = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.redis_sentinel_service_name = mymaster {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.redis_server = localhost:6379 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.retry_attempts = 2 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.retry_delay = 0.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.socket_keepalive_count = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.socket_keepalive_idle = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.socket_keepalive_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.socket_timeout = 1.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.tls_allowed_ciphers = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.tls_cafile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.tls_certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.tls_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.tls_keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cache.username = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] coordination.backend_url = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.asyncio_connection = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.asyncio_slave_connection = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.backend = sqlalchemy {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.connection = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.connection_debug = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.connection_parameters = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.connection_recycle_time = 3600 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.connection_trace = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.db_inc_retry_interval = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.db_max_retries = 20 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.db_max_retry_interval = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.db_retry_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.max_overflow = 50 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.max_pool_size = 5 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.max_retries = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.mysql_wsrep_sync_wait = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.pool_timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.retry_interval = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.slave_connection = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.sqlite_synchronous = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.synchronous_reader = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] database.use_db_reconnect = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.connection_string = messaging:// {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.es_doc_type = notification {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.es_scroll_size = 10000 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.es_scroll_time = 2m {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.filter_error_trace = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.hmac_keys = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.sentinel_service_name = mymaster {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.socket_timeout = 0.1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.trace_requests = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler.trace_sqlalchemy = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler_jaeger.process_tags = {} {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler_jaeger.service_name_prefix = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] profiler_otlp.service_name_prefix = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.enforce_new_defaults = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.enforce_scope = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.policy_default_rule = default {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.policy_file = policy.yaml {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_policy.remote_timeout = 60.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.group = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.helper_command = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] privsep_osbrick.user = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.group = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.helper_command = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] cinder_sys_admin.user = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.auth_section = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.auth_type = password {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.cafile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.collect_timing = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.send_service_user_token = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.split_loggers = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] service_user.timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.auth_section = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.auth_type = password {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.collect_timing = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.region_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.split_loggers = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] glance.timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.backend_availability_zone = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.chap_password = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.chap_username = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.disk_geometry = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_client_cert = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_client_cert_key = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_data_namespace = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.driver_use_ssl = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.enable_unsupported_driver = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.extra_capabilities = {} {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.filter_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.goodness_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iscsi_target_flags = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iscsi_write_cache = on {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iser_helper = tgtadm {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iser_port = 3260 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.lvm_mirrors = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.lvm_share_target = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.lvm_type = auto {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.num_shell_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.nvmet_port_id = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.replication_device = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.report_discard_supported = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.reserved_percentage = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.scst_target_driver = iscsi {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.scst_target_iqn_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.storage_protocol = iSCSI {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_helper = tgtadm {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_port = 3260 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_protocol = iscsi {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.trace_flags = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.unique_fqdn_network = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.use_chap_auth = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_backend_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_clear = zero {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_clear_ionice = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_clear_size = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volume_group = cinder-volumes {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_reports.file_event_handler = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_reports.log_dir = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.backend_availability_zone = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.backend_host = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.chap_password = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.chap_username = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.chiscsi_conf = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.disk_geometry = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_client_cert = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_data_namespace = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.driver_use_ssl = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.extra_capabilities = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.filter_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.goodness_function = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iser_helper = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iser_ip_address = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iser_port = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.iser_target_prefix = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.lvm_conf_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.lvm_mirrors = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.lvm_share_target = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.lvm_type = auto {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.num_shell_tries = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.nvmet_port_id = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.replication_device = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.report_discard_supported = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.reserved_percentage = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.scst_target_driver = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.storage_protocol = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_helper = lioadm {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_ip_address = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_port = 3260 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_protocol = iscsi {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.trace_flags = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.use_chap_auth = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_clear = zero {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_clear_size = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] lvmdriver-1.volumes_dir = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.ssl_version = {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_notifications.driver = [] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_notifications.retry = -1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] key_manager.fixed_key = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.barbican_api_version = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.barbican_endpoint = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.barbican_endpoint_type = public {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.barbican_region_name = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.cafile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.collect_timing = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.number_of_retries = 60 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.retry_delay = 1 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.send_service_user_token = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.split_loggers = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.verify_ssl = True {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican.verify_ssl_path = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.auth_section = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.auth_type = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.cafile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.certfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.collect_timing = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.insecure = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.keyfile = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.split_loggers = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] barbican_service_user.timeout = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.approle_role_id = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.approle_secret_id = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.kv_mountpoint = secret {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.kv_path = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.kv_version = 2 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.namespace = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.root_token_id = **** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.ssl_ca_crt_file = None {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.timeout = 60.0 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.use_ssl = False {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:24:18 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] ******************************************************************************** {{(pid=76502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:24:19 devstack sudo[76676]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:19 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:19 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:19 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:19 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:19 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:19 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.739s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:19 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:24:20 devstack cinder-volume[76671]: INFO cinder.brick.local_dev.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:20 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:20 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:20 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG cinder.brick.local_dev.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76671) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 22:24:20 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:20 devstack sudo[77241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:20 devstack sudo[77241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:22 devstack sudo[77241]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.288s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:22 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:22 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:22 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.752s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:22 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:22 devstack sudo[77456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 22:24:22 devstack sudo[77456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:23 devstack sudo[77456]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:23 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.709s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:23 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:23 devstack sudo[77460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:23 devstack sudo[77460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:24 devstack sudo[77460]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:24 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.911s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:24 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:24 devstack sudo[77471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:24 devstack sudo[77471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:25 devstack sudo[77471]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:25 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.904s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:25 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:25 devstack sudo[77477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:25 devstack sudo[77477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:26 devstack sudo[77477]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:26 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.055s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:26 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:26 devstack sudo[77487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:26 devstack sudo[77487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:27 devstack sudo[77487]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:27 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.739s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:27 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:27 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:27 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:27 devstack sudo[77492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:27 devstack sudo[77492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:28 devstack sudo[77492]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.977s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:28 devstack cinder-volume[76671]: INFO cinder.volume.drivers.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:28 devstack sudo[77615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:28 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:28 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:24:28 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:24:28 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:28 devstack sudo[77619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:28 devstack sudo[77619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:29 devstack sudo[77619]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:29 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:29 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:29 devstack sudo[77622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:29 devstack sudo[77622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:30 devstack sudo[77622]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:30 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:30 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:30 devstack sudo[77625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:30 devstack sudo[77625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:31 devstack sudo[77625]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:31 devstack sudo[77628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:31 devstack sudo[77628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:31 devstack sudo[77628]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:31 devstack cinder-volume[76671]: INFO cinder.volume.driver [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG cinder.volume.driver [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76671) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG oslo_db.sqlalchemy.engines [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76671) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writer thread running {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG cinder.db.api [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Building query based on filter {{(pid=76671) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG cinder.image.image_utils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76671) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:24:31 devstack cinder-volume[76671]: INFO cinder.keymgr.migration [None req-550577be-40ce-41b4-b4a2-e1e465b56263 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:24:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:31 devstack sudo[77636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:31 devstack sudo[77636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:32 devstack sudo[77636]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:32 devstack sudo[77639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:32 devstack sudo[77639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:33 devstack sudo[77639]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:33 devstack sudo[77642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:33 devstack sudo[77642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:33 devstack sudo[77642]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:34 devstack sudo[77645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:34 devstack sudo[77645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:34 devstack sudo[77645]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:24:34 devstack cinder-volume[76671]: INFO cinder.volume.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Driver initialization completed successfully. Jul 07 22:24:34 devstack cinder-volume[76671]: INFO cinder.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Initiating service 2 cleanup Jul 07 22:24:34 devstack cinder-volume[76671]: INFO cinder.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Service 2 cleanup completed. Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG cinder.service [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Creating RPC server for service cinder-volume {{(pid=76671) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG cinder.service [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76671) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:24:34 devstack cinder-volume[76671]: INFO cinder.volume.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:24:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:34 devstack sudo[77649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:24:34 devstack sudo[77649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:35 devstack sudo[77649]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:35 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:35 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:35 devstack sudo[77655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:35 devstack sudo[77655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:36 devstack sudo[77655]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:36 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:36 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:36 devstack sudo[77658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:24:36 devstack sudo[77658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:37 devstack sudo[77658]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:37 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:37 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:37 devstack sudo[77661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:24:37 devstack sudo[77661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:37 devstack sudo[77661]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:37 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:37 devstack cinder-volume[76671]: INFO cinder.volume.manager [None req-41364c3a-b253-4279-ba63-53174d6dc269 None None] Driver post RPC initialization completed successfully. Jul 07 22:24:47 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:24:47 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:31 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:25:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:25:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:31 devstack sudo[77771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:25:31 devstack sudo[77771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:32 devstack sudo[77771]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:32 devstack sudo[77774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:25:32 devstack sudo[77774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:33 devstack sudo[77774]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:33 devstack sudo[77778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:25:33 devstack sudo[77778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:33 devstack sudo[77778]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:33 devstack sudo[78196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:25:33 devstack sudo[78196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:34 devstack sudo[78196]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:25:34 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager._thread_info {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:25:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread count: 6 {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:25:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread info: [<_MainThread(MainThread, started 131353164255360)>, , , , , ] {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:26:31 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:26:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:26:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:31 devstack sudo[79896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:26:31 devstack sudo[79896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:32 devstack sudo[79896]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:32 devstack sudo[79899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:26:32 devstack sudo[79899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:33 devstack sudo[79899]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:33 devstack sudo[79902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:26:33 devstack sudo[79902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:33 devstack sudo[79902]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:33 devstack sudo[79905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:26:33 devstack sudo[79905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:34 devstack sudo[79905]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:26:34 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager._thread_info {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:26:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread count: 6 {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:26:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread info: [<_MainThread(MainThread, started 131353164255360)>, , , , , ] {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:26:47 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:27:31 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:27:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:27:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:31 devstack sudo[83268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:27:31 devstack sudo[83268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:32 devstack sudo[83268]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:32 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:27:32 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:33 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:33 devstack sudo[83274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:27:33 devstack sudo[83274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:33 devstack sudo[83274]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:33 devstack sudo[83277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:27:33 devstack sudo[83277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:34 devstack sudo[83277]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:27:34 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager._thread_info {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:27:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread count: 6 {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:27:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread info: [<_MainThread(MainThread, started 131353164255360)>, , , , , ] {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:28:31 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:28:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:28:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:31 devstack sudo[84852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:28:31 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:32 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:32 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:28:32 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:33 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:33 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:28:33 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:34 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:34 devstack sudo[84923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:28:34 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:34 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:28:47 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writing DB stats cinder:SELECT=1 {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:28:47 devstack cinder-volume[76671]: DEBUG dbcounter [-] [76671] Writing DB stats cinder:UPDATE=1 {{(pid=76671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:29:31 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:29:31 devstack cinder-volume[76671]: DEBUG cinder.volume.drivers.lvm [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Updating volume stats {{(pid=76671) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:29:31 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:31 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:29:31 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:32 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:32 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:32 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:29:32 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:33 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:33 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:29:33 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:33 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:33 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:33 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:29:33 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:34 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:34 devstack cinder-volume[76671]: DEBUG oslo_concurrency.processutils [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:34 devstack cinder-volume[76671]: DEBUG cinder.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Notifying Schedulers of capabilities ... {{(pid=76671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:34 devstack cinder-volume[76671]: DEBUG oslo_service.periodic_task [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] Running periodic task VolumeManager._thread_info {{(pid=76671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:29:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread count: 6 {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:29:34 devstack cinder-volume[76671]: DEBUG cinder.volume.manager [None req-c2864387-85e1-4b08-8889-dc2494232461 None None] thread info: [<_MainThread(MainThread, started 131353164255360)>, , , , , ] {{(pid=76671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:30:24 devstack cinder-volume[76502]: INFO oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Caught SIGTERM, stopping children Jul 07 22:30:24 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Acquiring lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:24 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Acquired lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:24 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Releasing lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:24 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Stop services. {{(pid=76502) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 22:30:24 devstack cinder-volume[76502]: DEBUG oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Killing children. {{(pid=76502) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 22:30:24 devstack cinder-volume[76502]: INFO oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Waiting on 1 children to exit Jul 07 22:30:24 devstack cinder-volume[76671]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Acquiring lock "singleton_lock" {{(pid=76671) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:24 devstack cinder-volume[76671]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Acquired lock "singleton_lock" {{(pid=76671) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:24 devstack cinder-volume[76671]: DEBUG oslo_concurrency.lockutils [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Releasing lock "singleton_lock" {{(pid=76671) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:24 devstack cinder-volume[76671]: WARNING amqp [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:30:24 devstack cinder-volume[76671]: WARNING amqp [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:30:24 devstack cinder-volume[76502]: INFO oslo_service.backend._eventlet.service [None req-57a9534c-8e58-40d0-9dbc-96c30be9e9ea None None] Child 76671 exited with status 0 Jul 07 22:30:25 devstack cinder-volume[87312]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:30:25 devstack cinder-volume[87312]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:30:25 devstack cinder-volume[87312]: we strongly recommend against using it for new projects. Jul 07 22:30:25 devstack cinder-volume[87312]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:30:25 devstack cinder-volume[87312]: framework. For more detail see Jul 07 22:30:25 devstack cinder-volume[87312]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:30:25 devstack cinder-volume[87312]: import eventlet # noqa Jul 07 22:30:27 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:27 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:27 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:28 devstack cinder-volume[87312]: INFO dbcounter [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Registered counter for database cinder Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_db.sqlalchemy.engines [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG dbcounter [-] [87312] Writer thread running {{(pid=87312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:30:28 devstack cinder-volume[87312]: INFO cinder.rpc [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:30:28 devstack cinder-volume[87312]: INFO cinder.rpc [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_db.sqlalchemy.engines [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:28 devstack cinder-volume[87312]: INFO cinder.volume.manager [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Determined volume DB was empty at startup. Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG cinder.volume.manager [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87312) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:30:28 devstack cinder-volume[87312]: INFO cinder.volume.manager [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 22:30:28 devstack cinder-volume[87312]: WARNING stevedore.named [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:30:28 devstack cinder-volume[87312]: WARNING castellan.key_manager [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:30:28 devstack cinder-volume[87312]: WARNING cinder.keymgr.conf_key_mgr [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:30:28 devstack cinder-volume[87312]: INFO cinder.volume.manager [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_db.sqlalchemy.engines [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:28 devstack cinder-volume[87312]: INFO oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Starting 1 workers Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Started child 87524 {{(pid=87312) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Full set of CONF: {{(pid=87312) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] ******************************************************************************** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Configuration options gathered from: {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] ================================================================================ {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] allow_availability_zone_fallback = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] allow_compression_on_image_upload = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] allowed_direct_url_schemes = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] api_rate_limit = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] auth_strategy = keystone {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_availability_zone = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87524]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_host = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_stats_polling_interval = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backup_api_class = cinder.backup.api.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backup_name_template = backup-%s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backup_use_same_host = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backup_use_temp_snapshot = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] chap_password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] chap_username = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_internal_tenant_project_id = 91709c9ad09f4b899ad8acf1efd3d649 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_internal_tenant_user_id = 488847c54ed941faa7b420d65ec245e5 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cluster = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] compression_format = gzip {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] compute_api_class = cinder.compute.nova.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] config_dir = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] config_source = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] control_exchange = openstack {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] debug = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] default_availability_zone = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] default_group_type = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] default_volume_type = QuobyteHD {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] disk_geometry = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_client_cert = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_client_cert_key = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_data_namespace = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_ssl_cert_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:28 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_ssl_cert_verify = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] driver_use_ssl = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] enable_new_services = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] enable_unsupported_driver = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] enabled_backends = ['QuobyteHD'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] enforce_multipath_for_image_xfer = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] filter_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_api_insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_api_ssl_compression = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_ca_certificates_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_catalog_info = image:glance:publicURL {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_num_retries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance_request_timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] goodness_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] graceful_shutdown_timeout = 5 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] group_api_class = cinder.group.api.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] host = devstack {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87524]: INFO cinder.volume.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_compress_on_upload = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.remotefs [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87524) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_conversion_address_space_limit = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_conversion_cpu_limit = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_conversion_disable = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_upload_use_cinder_backend = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_upload_use_internal_tenant = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_volume_cache_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_volume_cache_max_count = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] image_volume_cache_max_size_gb = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] init_host_max_objects_retrieval = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] instance_format = [instance: %(uuid)s] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iscsi_target_flags = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iscsi_write_cache = on {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iser_helper = tgtadm {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iser_ip_address = 192.168.122.119 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iser_port = 3260 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_color = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_config_append = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_dir = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_options = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_rotate_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_rotate_interval_type = days {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] log_rotation_type = none {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] max_age = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] max_logfile_count = 30 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] max_logfile_size_mb = 200 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] max_over_subscription_ratio = 20.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] message_reap_interval = 86400 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] message_ttl = 2592000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] migration_create_volume_timeout_secs = 300 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] monkey_patch = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] monkey_patch_modules = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] my_ip = 192.168.122.119 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] no_snapshot_gb_quota = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] num_iser_scan_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] num_shell_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] num_volume_device_scan_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] nvmeof_conn_info_version = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] nvmet_ns_id = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] nvmet_port_id = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_max_limit = 1000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_ext_list = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_listen_port = 8776 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_use_ssl = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] osapi_volume_workers = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] per_volume_size_limit = -1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] periodic_fuzzy_delay = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] periodic_interval = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] public_endpoint = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] publish_errors = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_backup_gigabytes = 1000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_backups = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_gigabytes = 1000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_groups = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_snapshots = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] quota_volumes = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] rate_limit_burst = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] rate_limit_except_level = CRITICAL {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] rate_limit_interval = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] reinit_driver_count = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] replication_device = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] report_discard_supported = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] report_interval = 120 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] reservation_clean_interval = 86400 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] reservation_expire = 86400 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] reserved_image_namespaces = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] reserved_percentage = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] rpc_response_timeout = 120 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] run_external_periodic_tasks = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] scst_target_driver = iscsi {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] scst_target_iqn_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_down_time = 720 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] shell_completion = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] snapshot_name_template = snapshot-%s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] split_loggers = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] state_path = /opt/stack/data/cinder {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] storage_availability_zone = nova {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] storage_protocol = iSCSI {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] syslog_log_facility = LOG_USER {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_helper = lioadm {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_ip_address = 192.168.122.119 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_port = 3260 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_protocol = iscsi {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] target_secondary_ip_addresses = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] trace_flags = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] transport_url = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] until_refresh = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_chap_auth = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_default_quota_class = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_journal = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_json = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_multipath_for_image_xfer = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_stderr = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] use_syslog = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] verify_glance_signatures = enabled {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_api_class = cinder.volume.api.API {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_backend_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_clear = zero {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_clear_ionice = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_clear_size = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_copy_bps_limit = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_dd_blocksize = 1M {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_name_template = volume-%s {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_service_inithost_offload = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volume_usage_audit_period = month {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] zoning_mode = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_concurrency.disable_process_locking = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.auth_section = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.auth_type = password {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.auth_version = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.cache = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.include_service_catalog = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.interface = public {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_password = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87524) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcache_username = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.region_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.service_type = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: WARNING cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: WARNING cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.backend = dogpile.cache.null {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.backend_argument = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.backend_expiration_time = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.config_prefix = cache.oslo {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.debug_cache_backend = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.enable_retry_client = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.enable_socket_keepalive = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.expiration_time = 600 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.hashclient_retry_attempts = 2 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_dead_retry = 300 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Running cmd (subprocess): mount.quobyte {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_pool_maxsize = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_sasl_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.proxies = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.redis_db = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.redis_server = localhost:6379 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.retry_attempts = 2 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.retry_delay = 0.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.socket_keepalive_count = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.socket_keepalive_idle = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.socket_keepalive_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.socket_timeout = 1.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.tls_allowed_ciphers = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.tls_cafile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.tls_certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.tls_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.tls_keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cache.username = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] coordination.backend_url = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.asyncio_connection = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.asyncio_slave_connection = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.backend = sqlalchemy {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.connection = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.connection_debug = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.connection_parameters = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.connection_recycle_time = 3600 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.connection_trace = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.db_inc_retry_interval = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.db_max_retries = 20 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.db_max_retry_interval = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.db_retry_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.max_overflow = 50 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.max_pool_size = 5 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.max_retries = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.mysql_wsrep_sync_wait = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.pool_timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.retry_interval = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.slave_connection = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.sqlite_synchronous = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.synchronous_reader = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] database.use_db_reconnect = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.connection_string = messaging:// {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.es_doc_type = notification {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.es_scroll_size = 10000 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.es_scroll_time = 2m {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.filter_error_trace = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.hmac_keys = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.sentinel_service_name = mymaster {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.socket_timeout = 0.1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.trace_requests = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler.trace_sqlalchemy = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler_jaeger.process_tags = {} {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler_jaeger.service_name_prefix = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] profiler_otlp.service_name_prefix = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.enforce_new_defaults = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.enforce_scope = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.policy_default_rule = default {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.policy_file = policy.yaml {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.group = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.helper_command = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] privsep_osbrick.user = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.group = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.helper_command = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] cinder_sys_admin.user = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.auth_section = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.auth_type = password {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.cafile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.collect_timing = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.send_service_user_token = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.split_loggers = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] service_user.timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.auth_section = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.auth_type = password {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.collect_timing = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.region_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.split_loggers = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] glance.timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.backend_availability_zone = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.chap_password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.chap_username = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.disk_geometry = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_client_cert = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_client_cert_key = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_data_namespace = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.driver_use_ssl = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.extra_capabilities = {} {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.filter_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.goodness_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iscsi_target_flags = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iscsi_write_cache = on {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iser_helper = tgtadm {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iser_port = 3260 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_host = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_login = admin {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_mount_options = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_private_key = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_share_path = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.num_shell_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.quobyte_volume_url = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.replication_device = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.report_discard_supported = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.reserved_percentage = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_helper = tgtadm {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_port = 3260 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_protocol = iscsi {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.trace_flags = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.unique_fqdn_network = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.use_chap_auth = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_backend_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_clear = zero {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_clear_ionice = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_clear_size = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_reports.file_event_handler = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_reports.log_dir = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.backend_availability_zone = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.backend_host = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.chap_password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.chap_username = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.chiscsi_conf = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.disk_geometry = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_client_cert = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_data_namespace = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.driver_use_ssl = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.extra_capabilities = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.filter_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.goodness_function = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iser_helper = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iser_ip_address = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iser_port = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.iser_target_prefix = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_host = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_login = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_mount_options = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_password = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_private_key = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_share_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_ssh_port = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.num_shell_tries = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.nvmet_port_id = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.replication_device = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.report_discard_supported = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.reserved_percentage = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.scst_target_driver = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.storage_protocol = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_helper = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_ip_address = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_port = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_prefix = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_protocol = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.trace_flags = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.use_chap_auth = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_clear = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_clear_size = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] QuobyteHD.volumes_dir = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack quobyte-client[87529]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 22:30:29 devstack quobyte-client[87529]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_notifications.driver = [] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_notifications.retry = -1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=87524) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] key_manager.fixed_key = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.barbican_api_version = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.barbican_endpoint = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.barbican_endpoint_type = public {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.barbican_region_name = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.cafile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.collect_timing = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.number_of_retries = 60 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.retry_delay = 1 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.send_service_user_token = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.split_loggers = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: INFO cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c ... Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.verify_ssl = True {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican.verify_ssl_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 -c /etc/quobyte/client-cinder.cfg {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.auth_section = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.auth_type = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.cafile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.certfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.collect_timing = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.insecure = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.keyfile = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.split_loggers = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] barbican_service_user.timeout = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.approle_role_id = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.approle_secret_id = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.kv_mountpoint = secret {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.kv_path = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.kv_version = 2 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.namespace = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.root_token_id = **** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.ssl_ca_crt_file = None {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.timeout = 60.0 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.use_ssl = False {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:29 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] ******************************************************************************** {{(pid=87312) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:30:29 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 -c /etc/quobyte/client-cinder.cfg Jul 07 22:30:29 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:30 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.780s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:30 devstack cinder-volume[87524]: INFO cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c succeeded Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=87524) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.798s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:30 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:30 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:30 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.668s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:30 devstack cinder-volume[87524]: INFO cinder.volume.driver [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.volume.driver [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87524) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87524) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG dbcounter [-] [87524] Writer thread running {{(pid=87524) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.db.api [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Building query based on filter {{(pid=87524) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.image.image_utils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87524) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:30:30 devstack cinder-volume[87524]: INFO cinder.keymgr.migration [None req-881116b6-af96-4406-bbf5-5865d16a00e6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=87524) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=87524) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:30 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:30 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:30 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:31 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.731s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG cinder.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Notifying Schedulers of capabilities ... {{(pid=87524) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:31 devstack cinder-volume[87524]: INFO cinder.volume.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Driver initialization completed successfully. Jul 07 22:30:31 devstack cinder-volume[87524]: INFO cinder.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Initiating service 3 cleanup Jul 07 22:30:31 devstack cinder-volume[87524]: INFO cinder.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Service 3 cleanup completed. Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG cinder.service [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Creating RPC server for service cinder-volume {{(pid=87524) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG cinder.service [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87524) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:30:31 devstack cinder-volume[87524]: INFO cinder.volume.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=87524) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=87524) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:31 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:31 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:31 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:32 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:32 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.924s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:32 devstack cinder-volume[87524]: INFO cinder.volume.manager [None req-d6ef0e03-e062-4b00-8a46-f90723435481 None None] Driver post RPC initialization completed successfully. Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=87524) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG cinder.volume.drivers.quobyte [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=87524) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87524) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:36 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:36 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:36 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG oslo_concurrency.processutils [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.669s {{(pid=87524) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:36 devstack cinder-volume[87524]: DEBUG cinder.manager [None req-90fd0af3-a709-4f75-bcf6-9df610f42b0d None None] Notifying Schedulers of capabilities ... {{(pid=87524) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:37 devstack cinder-volume[87312]: INFO oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Caught SIGTERM, stopping children Jul 07 22:30:37 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Acquiring lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:37 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Acquired lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:37 devstack cinder-volume[87312]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Releasing lock "singleton_lock" {{(pid=87312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:37 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Stop services. {{(pid=87312) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 22:30:37 devstack cinder-volume[87312]: DEBUG oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Killing children. {{(pid=87312) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 22:30:37 devstack cinder-volume[87312]: INFO oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Waiting on 1 children to exit Jul 07 22:30:40 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Acquiring lock "singleton_lock" {{(pid=87524) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:40 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Acquired lock "singleton_lock" {{(pid=87524) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:40 devstack cinder-volume[87524]: DEBUG oslo_concurrency.lockutils [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Releasing lock "singleton_lock" {{(pid=87524) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:40 devstack cinder-volume[87524]: WARNING amqp [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:30:40 devstack cinder-volume[87524]: WARNING amqp [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:30:40 devstack cinder-volume[87312]: INFO oslo_service.backend._eventlet.service [None req-06cfad3d-088e-4ac2-95b7-b5bbfc0dfb6d None None] Child 87524 exited with status 0 Jul 07 22:30:40 devstack cinder-volume[87803]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:30:40 devstack cinder-volume[87803]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:30:40 devstack cinder-volume[87803]: we strongly recommend against using it for new projects. Jul 07 22:30:40 devstack cinder-volume[87803]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:30:40 devstack cinder-volume[87803]: framework. For more detail see Jul 07 22:30:40 devstack cinder-volume[87803]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:30:40 devstack cinder-volume[87803]: import eventlet # noqa Jul 07 22:30:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:30:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:30:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:30:44 devstack cinder-volume[87803]: INFO dbcounter [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Registered counter for database cinder Jul 07 22:30:44 devstack cinder-volume[87803]: DEBUG oslo_db.sqlalchemy.engines [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:44 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writer thread running {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:30:44 devstack cinder-volume[87803]: INFO cinder.rpc [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:30:44 devstack cinder-volume[87803]: INFO cinder.rpc [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:30:44 devstack cinder-volume[87803]: DEBUG oslo_db.sqlalchemy.engines [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Determined volume DB was empty at startup. Jul 07 22:30:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87803) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:30:44 devstack cinder-volume[87803]: WARNING stevedore.named [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:30:44 devstack cinder-volume[87803]: WARNING castellan.key_manager [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:30:44 devstack cinder-volume[87803]: WARNING cinder.keymgr.conf_key_mgr [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:30:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_db.sqlalchemy.engines [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:45 devstack cinder-volume[87803]: INFO oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Starting 1 workers Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Started child 88087 {{(pid=87803) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Full set of CONF: {{(pid=87803) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] ******************************************************************************** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] Configuration options gathered from: {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] ================================================================================ {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] allow_availability_zone_fallback = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] allow_compression_on_image_upload = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] allowed_direct_url_schemes = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] api_rate_limit = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] auth_strategy = keystone {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_availability_zone = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_host = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_stats_polling_interval = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backup_api_class = cinder.backup.api.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backup_name_template = backup-%s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backup_use_same_host = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backup_use_temp_snapshot = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[88087]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] chap_password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] chap_username = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_internal_tenant_project_id = 91709c9ad09f4b899ad8acf1efd3d649 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_internal_tenant_user_id = 488847c54ed941faa7b420d65ec245e5 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cluster = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] compression_format = gzip {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] compute_api_class = cinder.compute.nova.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] config_dir = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] config_source = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] control_exchange = openstack {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] debug = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] default_availability_zone = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] default_group_type = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] default_volume_type = QuobyteHD {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] disk_geometry = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_client_cert = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_client_cert_key = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_data_namespace = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_ssl_cert_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_ssl_cert_verify = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] driver_use_ssl = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] enable_new_services = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] enable_unsupported_driver = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] enabled_backends = ['QuobyteHD'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] enforce_multipath_for_image_xfer = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] filter_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_api_insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_api_ssl_compression = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_ca_certificates_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_catalog_info = image:glance:publicURL {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_num_retries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance_request_timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] goodness_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] graceful_shutdown_timeout = 5 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] group_api_class = cinder.group.api.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] host = devstack {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_compress_on_upload = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_conversion_address_space_limit = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_conversion_cpu_limit = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_conversion_disable = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_upload_use_cinder_backend = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_upload_use_internal_tenant = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_volume_cache_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_volume_cache_max_count = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] image_volume_cache_max_size_gb = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] init_host_max_objects_retrieval = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] instance_format = [instance: %(uuid)s] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iscsi_target_flags = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iscsi_write_cache = on {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iser_helper = tgtadm {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iser_ip_address = 192.168.122.119 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iser_port = 3260 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_color = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_config_append = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_dir = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_options = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_rotate_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_rotate_interval_type = days {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] log_rotation_type = none {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] max_age = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] max_logfile_count = 30 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] max_logfile_size_mb = 200 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] max_over_subscription_ratio = 20.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] message_reap_interval = 86400 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] message_ttl = 2592000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] migration_create_volume_timeout_secs = 300 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] monkey_patch = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] monkey_patch_modules = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] my_ip = 192.168.122.119 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] no_snapshot_gb_quota = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] num_iser_scan_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] num_shell_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] num_volume_device_scan_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88087) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] nvmeof_conn_info_version = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] nvmet_ns_id = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] nvmet_port_id = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_max_limit = 1000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_ext_list = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_listen_port = 8776 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_use_ssl = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] osapi_volume_workers = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] per_volume_size_limit = -1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] periodic_fuzzy_delay = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] periodic_interval = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] public_endpoint = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] publish_errors = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_backup_gigabytes = 1000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_backups = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_gigabytes = 1000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_groups = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_snapshots = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] quota_volumes = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] rate_limit_burst = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] rate_limit_except_level = CRITICAL {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] rate_limit_interval = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] reinit_driver_count = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] replication_device = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] report_discard_supported = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] report_interval = 120 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] reservation_clean_interval = 86400 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] reservation_expire = 86400 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] reserved_image_namespaces = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] reserved_percentage = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] rpc_response_timeout = 120 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] run_external_periodic_tasks = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] scst_target_driver = iscsi {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] scst_target_iqn_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_down_time = 720 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] shell_completion = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] snapshot_name_template = snapshot-%s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] split_loggers = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] state_path = /opt/stack/data/cinder {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] storage_availability_zone = nova {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] storage_protocol = iSCSI {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] syslog_log_facility = LOG_USER {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_helper = lioadm {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_ip_address = 192.168.122.119 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_port = 3260 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_protocol = iscsi {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] target_secondary_ip_addresses = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] trace_flags = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] transport_url = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] until_refresh = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_chap_auth = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_default_quota_class = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_journal = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_json = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_multipath_for_image_xfer = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_stderr = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] use_syslog = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] verify_glance_signatures = enabled {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_api_class = cinder.volume.api.API {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_backend_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_clear = zero {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_clear_ionice = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_clear_size = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_copy_bps_limit = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_dd_blocksize = 1M {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_name_template = volume-%s {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_service_inithost_offload = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volume_usage_audit_period = month {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] zoning_mode = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_concurrency.disable_process_locking = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.auth_section = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.auth_type = password {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.auth_version = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.cache = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.include_service_catalog = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.interface = public {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_password = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88087) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 22:30:45 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcache_username = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.region_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.service_type = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Running cmd (subprocess): mount.quobyte {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.backend = dogpile.cache.null {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.backend_argument = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.backend_expiration_time = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.config_prefix = cache.oslo {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.debug_cache_backend = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.enable_retry_client = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.enable_socket_keepalive = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.expiration_time = 600 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.hashclient_retry_attempts = 2 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_dead_retry = 300 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_pool_maxsize = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_sasl_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.proxies = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.redis_db = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.redis_server = localhost:6379 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.retry_attempts = 2 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.retry_delay = 0.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.socket_keepalive_count = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.socket_keepalive_idle = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.socket_keepalive_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.socket_timeout = 1.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.tls_allowed_ciphers = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.tls_cafile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.tls_certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.tls_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.tls_keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cache.username = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] coordination.backend_url = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.asyncio_connection = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.asyncio_slave_connection = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.backend = sqlalchemy {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.connection = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.connection_debug = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.connection_parameters = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.connection_recycle_time = 3600 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.connection_trace = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.db_inc_retry_interval = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.db_max_retries = 20 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.db_max_retry_interval = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.db_retry_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.max_overflow = 50 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.max_pool_size = 5 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.max_retries = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.mysql_wsrep_sync_wait = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.pool_timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.retry_interval = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.slave_connection = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.sqlite_synchronous = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.synchronous_reader = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] database.use_db_reconnect = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.connection_string = messaging:// {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.es_doc_type = notification {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.es_scroll_size = 10000 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.es_scroll_time = 2m {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.filter_error_trace = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.hmac_keys = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.sentinel_service_name = mymaster {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.socket_timeout = 0.1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.trace_requests = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler.trace_sqlalchemy = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler_jaeger.process_tags = {} {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler_jaeger.service_name_prefix = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] profiler_otlp.service_name_prefix = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.enforce_new_defaults = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.enforce_scope = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.policy_default_rule = default {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.policy_file = policy.yaml {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.group = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.helper_command = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] privsep_osbrick.user = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.group = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.helper_command = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] cinder_sys_admin.user = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.auth_section = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.auth_type = password {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.cafile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.collect_timing = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.send_service_user_token = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.split_loggers = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] service_user.timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.auth_section = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.auth_type = password {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.collect_timing = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.region_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.split_loggers = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] glance.timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.backend_availability_zone = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.chap_password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.chap_username = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.disk_geometry = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_client_cert = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_client_cert_key = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_data_namespace = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.driver_use_ssl = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.extra_capabilities = {} {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.filter_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.goodness_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iscsi_target_flags = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iscsi_write_cache = on {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iser_helper = tgtadm {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iser_port = 3260 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_host = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_login = admin {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_mount_options = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_private_key = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_share_path = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.num_shell_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.quobyte_volume_url = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.replication_device = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.report_discard_supported = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.reserved_percentage = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_helper = tgtadm {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_port = 3260 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_protocol = iscsi {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.trace_flags = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.unique_fqdn_network = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.use_chap_auth = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_backend_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_clear = zero {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_clear_ionice = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_clear_size = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_reports.file_event_handler = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_reports.log_dir = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.backend_availability_zone = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.backend_host = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.chap_password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.chap_username = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.chiscsi_conf = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.disk_geometry = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_client_cert = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_data_namespace = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.driver_use_ssl = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.extra_capabilities = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.filter_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.goodness_function = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iser_helper = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iser_ip_address = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iser_port = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.iser_target_prefix = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_host = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_login = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_mount_options = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_password = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_private_key = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_share_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_ssh_port = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.num_shell_tries = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.nvmet_port_id = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.replication_device = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.report_discard_supported = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.reserved_percentage = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.scst_target_driver = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.storage_protocol = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_helper = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_ip_address = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_port = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_prefix = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_protocol = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.trace_flags = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.use_chap_auth = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_clear = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_clear_size = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] QuobyteHD.volumes_dir = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_notifications.driver = [] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_notifications.retry = -1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] key_manager.fixed_key = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.barbican_api_version = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.barbican_endpoint = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.barbican_endpoint_type = public {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.barbican_region_name = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.cafile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.collect_timing = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.number_of_retries = 60 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.retry_delay = 1 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.send_service_user_token = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.split_loggers = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.verify_ssl = True {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican.verify_ssl_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.auth_section = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.auth_type = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.cafile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.certfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.collect_timing = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.insecure = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.keyfile = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.split_loggers = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] barbican_service_user.timeout = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.approle_role_id = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.approle_secret_id = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.kv_mountpoint = secret {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.kv_path = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.kv_version = 2 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.namespace = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.root_token_id = **** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.ssl_ca_crt_file = None {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.timeout = 60.0 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.use_ssl = False {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:30:45 devstack cinder-volume[87803]: DEBUG oslo_service.backend._eventlet.service [None req-42591f9d-9af1-48fa-a632-1ed4a71f4a52 None None] ******************************************************************************** {{(pid=87803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:30:45 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.644s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:45 devstack cinder-volume[88087]: INFO cinder.volume.driver [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG cinder.volume.driver [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88087) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:30:45 devstack cinder-volume[88087]: DEBUG oslo_db.sqlalchemy.engines [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writer thread running {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.db.api [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Building query based on filter {{(pid=88087) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88087) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:46 devstack cinder-volume[88087]: INFO cinder.keymgr.migration [None req-afa7e882-ae90-43ed-9d0c-b400ac4913b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:30:46 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:46 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:46 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.630s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Driver initialization completed successfully. Jul 07 22:30:46 devstack cinder-volume[88087]: INFO cinder.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Initiating service 3 cleanup Jul 07 22:30:46 devstack cinder-volume[88087]: INFO cinder.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Service 3 cleanup completed. Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.service [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Creating RPC server for service cinder-volume {{(pid=88087) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.service [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88087) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:30:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:46 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:30:46 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:47 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.627s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-21ecfb6c-da6e-44cd-bd2e-185c5960a4b4 None None] Driver post RPC initialization completed successfully. Jul 07 22:30:55 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:30:56 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:30:57 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:31:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:31:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 6 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:31:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:15 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:32:15 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:17 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.539s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:17 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:32:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 6 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:32:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Flow 'volume_create_manager' (d7e8a2e2-b731-4eef-afa6-0a9e46f29c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3639ee7-33f2-4443-951d-2002e7c4a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3639ee7-33f2-4443-951d-2002e7c4a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-444525325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df53302b-431d-465b-9128-940ecc3c04ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26b70f7261444b78477a7e007d474b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:22Z,use_quota=True,user_id='97523d544e124a88be726ee275ba3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30285edf-7848-491b-8718-6f2ffa19be63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30285edf-7848-491b-8718-6f2ffa19be63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d612743-3165-46d9-97ff-24b90721344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d612743-3165-46d9-97ff-24b90721344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df53302b-431d-465b-9128-940ecc3c04ee', 'volume_name': 'volume-df53302b-431d-465b-9128-940ecc3c04ee', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553cb407-a366-4cb4-8f97-d5fde56b342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553cb407-a366-4cb4-8f97-d5fde56b342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8078ea-4cca-4b77-8b76-0fa0556f5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:22 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Volume df53302b-431d-465b-9128-940ecc3c04ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df53302b-431d-465b-9128-940ecc3c04ee', 'volume_size': 1} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-444525325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df53302b-431d-465b-9128-940ecc3c04ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26b70f7261444b78477a7e007d474b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:22Z,use_quota=True,user_id='97523d544e124a88be726ee275ba3f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Creating volume df53302b-431d-465b-9128-940ecc3c04ee {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:22 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:32:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:22 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee 1073741824 Jul 07 22:32:22 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:25 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee 1073741824" returned: 0 in 2.316s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:25 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee Jul 07 22:32:25 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:26 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee" returned: 0 in 1.575s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] <== create_volume: return (4059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.071s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8078ea-4cca-4b77-8b76-0fa0556f5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df53302b-431d-465b-9128-940ecc3c04ee', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4593c4c2-d681-4d08-9c59-1ed781ecf110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:26 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Volume volume-df53302b-431d-465b-9128-940ecc3c04ee (df53302b-431d-465b-9128-940ecc3c04ee): created successfully Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4593c4c2-d681-4d08-9c59-1ed781ecf110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Flow 'volume_create_manager' (d7e8a2e2-b731-4eef-afa6-0a9e46f29c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-774ecc57-4ae9-4ee9-a029-b6ad223ae307 tempest-VolumesAdminNegativeTest-2124747752 None] Created volume successfully. Jul 07 22:32:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Acquiring lock "cinder-df53302b-431d-465b-9128-940ecc3c04ee-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "cinder-df53302b-431d-465b-9128-940ecc3c04ee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Acquiring lock "cinder-quobyte-df53302b-431d-465b-9128-940ecc3c04ee" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "cinder-quobyte-df53302b-431d-465b-9128-940ecc3c04ee" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:28 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdjbok84x/privsep.sock'] Jul 07 22:32:28 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdjbok84x/privsep.sock Jul 07 22:32:28 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:32:29 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:32:30 devstack cinder-volume[88087]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 22:32:31 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:31 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Spawned new privsep daemon via rootwrap Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Accepted privsep connection to /tmp/tmpdjbok84x/privsep.sock {{(pid=88087) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 22:32:31 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 22:32:31 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 22:32:31 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 22:32:31 devstack cinder-volume[88087]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89307 Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86494bf-584a-482a-bbfe-7ffd30d22b36]: (2,) {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb609a24-f5a8-4388-87f6-b169430969e4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:31 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee Jul 07 22:32:31 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:31 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:31 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee Jul 07 22:32:31 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:32 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-df53302b-431d-465b-9128-940ecc3c04ee" returned: 0 in 0.736s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "cinder-quobyte-df53302b-431d-465b-9128-940ecc3c04ee" released by "delete_volume" :: held 3.710s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:32 devstack cinder-volume[88087]: WARNING cinder.quota [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:32:32 devstack cinder-volume[88087]: WARNING cinder.quota [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Created reservations ['0c96e118-1e30-4c88-87fb-6cfd4e01dd54', 'a502e7e8-e406-4256-9bb2-1abe17c094eb', '20ca14a4-a740-468b-bba8-f7b00a62c83a', '9438a0a2-56fb-452f-8bd2-557d9a29acd7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:32 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:32:32 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:33 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:33 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Deleted volume successfully. Jul 07 22:32:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0ebd380d-4cbb-46d3-8958-540b220cc77c tempest-VolumesAdminNegativeTest-2124747752 None] Lock "cinder-df53302b-431d-465b-9128-940ecc3c04ee-delete_volume" released by "delete_volume" :: held 4.931s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Flow 'volume_create_manager' (45654530-13c2-434b-b42c-ff28949ef30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdb7875-04da-4bb6-9955-cf2e8f1c6ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdb7875-04da-4bb6-9955-cf2e8f1c6ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1873485675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdd864-12e2-4311-9b7c-e87acfa784ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7988cd9c88e411f9ed5824a6cbfe9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:39Z,use_quota=True,user_id='911df8a78e684c65a10d91cc31660f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0474ae-b07b-4539-b520-818e0dc9ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0474ae-b07b-4539-b520-818e0dc9ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3206f7c5-4215-4c1a-9faf-78f448b186b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3206f7c5-4215-4c1a-9faf-78f448b186b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fdd864-12e2-4311-9b7c-e87acfa784ac', 'volume_name': 'volume-00fdd864-12e2-4311-9b7c-e87acfa784ac', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a76008e-2639-4844-92a1-695e285890f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a76008e-2639-4844-92a1-695e285890f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c10b7ee-94fb-4d22-b3c5-8ff0f881677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Volume 00fdd864-12e2-4311-9b7c-e87acfa784ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fdd864-12e2-4311-9b7c-e87acfa784ac', 'volume_size': 1} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1873485675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdd864-12e2-4311-9b7c-e87acfa784ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7988cd9c88e411f9ed5824a6cbfe9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:39Z,use_quota=True,user_id='911df8a78e684c65a10d91cc31660f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Creating volume 00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:38 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:32:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:38 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac 1073741824 Jul 07 22:32:38 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:39 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac 1073741824" returned: 0 in 1.086s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:39 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac Jul 07 22:32:39 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:40 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c10b7ee-94fb-4d22-b3c5-8ff0f881677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fdd864-12e2-4311-9b7c-e87acfa784ac', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3238aa-884e-457d-ac39-936e385c4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:40 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Volume volume-00fdd864-12e2-4311-9b7c-e87acfa784ac (00fdd864-12e2-4311-9b7c-e87acfa784ac): created successfully Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3238aa-884e-457d-ac39-936e385c4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Flow 'volume_create_manager' (45654530-13c2-434b-b42c-ff28949ef30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a0d5c20f-797a-43e8-8485-46800d56c785 tempest-ServerActionsTestOtherA-1636264360 None] Created volume successfully. Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (3c4d8369-102f-498c-bf75-0a2002eb7008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec32167-f946-42e1-b985-6d675ce8c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec32167-f946-42e1-b985-6d675ce8c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-947509875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b0d03e-ff61-456b-8880-93f4d01c7d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:42Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05c7d92-7eec-4495-bd52-bcd3301e327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05c7d92-7eec-4495-bd52-bcd3301e327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034a5031-c437-4898-b25d-e43f5219b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034a5031-c437-4898-b25d-e43f5219b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b0d03e-ff61-456b-8880-93f4d01c7d6f', 'volume_name': 'volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea0bbdc-4a39-454e-896a-ebf6158f3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea0bbdc-4a39-454e-896a-ebf6158f3555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a5cddc-4f22-4e7a-8c54-4d9be482e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Volume 28b0d03e-ff61-456b-8880-93f4d01c7d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f', 'volume_size': 1} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-947509875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b0d03e-ff61-456b-8880-93f4d01c7d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:42Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Creating volume 28b0d03e-ff61-456b-8880-93f4d01c7d6f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:42 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:32:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:42 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f 1073741824 Jul 07 22:32:42 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:43 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f 1073741824" returned: 0 in 1.132s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:43 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f Jul 07 22:32:43 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:44 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f" returned: 0 in 0.892s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a5cddc-4f22-4e7a-8c54-4d9be482e089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb01954-d8f7-431f-af67-2ec7991a5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Volume volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f (28b0d03e-ff61-456b-8880-93f4d01c7d6f): created successfully Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb01954-d8f7-431f-af67-2ec7991a5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (3c4d8369-102f-498c-bf75-0a2002eb7008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-426fcd5e-11d3-4653-af95-b8ced255d9f8 tempest-AttachVolumeTestJSON-1576231458 None] Created volume successfully. Jul 07 22:32:51 devstack cinder-volume[88087]: WARNING py.warnings [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 22:32:51 devstack cinder-volume[88087]: .first() Jul 07 22:32:51 devstack cinder-volume[88087]: Jul 07 22:32:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0daf9-b321-4128-8f13-ea3cca8d3469]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:51 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f Jul 07 22:32:51 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:52 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f" returned: 0 in 1.007s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '318f13ef-3ca9-443a-b70f-147bed440b98', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:32:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-ff520bed-1843-49f5-850d-ea66dd3e1e01 req-dc5db45c-766c-4963-8981-f6cee847f8f7 tempest-AttachVolumeTestJSON-1576231458 None] attachment_update completed successfully. Jul 07 22:33:02 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=14,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:33:03 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=20,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Flow 'volume_create_manager' (bb2ea9d1-a810-43be-b53e-f792fcec5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eff019e-897a-4ac7-b163-932b150227d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eff019e-897a-4ac7-b163-932b150227d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1860707201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d02d8b-b9ed-41b3-b684-bbfc96f72357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0694e402a8d34ec2858f251472690da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:04Z,use_quota=True,user_id='b4deda838a4d4c69a49bcce94257a444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e234e925-e320-4091-8479-ef4a7491d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e234e925-e320-4091-8479-ef4a7491d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb4d22-2490-4a1b-af23-a7ec8a739803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb4d22-2490-4a1b-af23-a7ec8a739803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d02d8b-b9ed-41b3-b684-bbfc96f72357', 'volume_name': 'volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379212ed-29a0-43b9-b7ae-66bb275feb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379212ed-29a0-43b9-b7ae-66bb275feb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a4ac6e-aee7-41a2-a7e5-d7b0101cc9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Volume 87d02d8b-b9ed-41b3-b684-bbfc96f72357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357', 'volume_size': 1} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1860707201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d02d8b-b9ed-41b3-b684-bbfc96f72357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0694e402a8d34ec2858f251472690da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:04Z,use_quota=True,user_id='b4deda838a4d4c69a49bcce94257a444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Creating volume 87d02d8b-b9ed-41b3-b684-bbfc96f72357 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:04 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:33:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:04 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 1073741824 Jul 07 22:33:04 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:05 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 1073741824" returned: 0 in 1.388s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:06 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 Jul 07 22:33:06 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:06 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357" returned: 0 in 0.868s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a4ac6e-aee7-41a2-a7e5-d7b0101cc9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a2158-e0fa-40f3-8896-7d664ded4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Volume volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 (87d02d8b-b9ed-41b3-b684-bbfc96f72357): created successfully Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a2158-e0fa-40f3-8896-7d664ded4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Flow 'volume_create_manager' (bb2ea9d1-a810-43be-b53e-f792fcec5c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d025c9c3-3e2c-403c-9ce2-3af15058f26f tempest-DeleteServersTestJSON-1437557451 None] Created volume successfully. Jul 07 22:33:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842af22-f1d7-45a4-87cb-75a04874d4f4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:13 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 Jul 07 22:33:13 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:14 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357" returned: 0 in 1.765s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.878s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b6ac50e-0f17-4af2-a5c8-0fae615984da', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:33:14 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-537e9b70-d8d6-4ef2-a430-7c57ec09f4d0 req-c2b3aeb3-52e6-466d-a7be-bc76e168ae1c tempest-DeleteServersTestJSON-1437557451 None] attachment_update completed successfully. Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:15 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:33:15 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:17 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.560s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:17 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:33:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 8 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:33:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:33:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-de0d0d7e-c76f-4580-affb-88b5a12bc03d req-5c3d96e7-14d4-4b1d-b470-ba81c1ac1084 tempest-DeleteServersTestJSON-1437557451 None] Terminate volume connection completed successfully. Jul 07 22:33:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-de0d0d7e-c76f-4580-affb-88b5a12bc03d req-5c3d96e7-14d4-4b1d-b470-ba81c1ac1084 tempest-DeleteServersTestJSON-1437557451 None] Deleting attachment 1b6ac50e-0f17-4af2-a5c8-0fae615984da. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "cinder-87d02d8b-b9ed-41b3-b684-bbfc96f72357-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "cinder-87d02d8b-b9ed-41b3-b684-bbfc96f72357-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "cinder-quobyte-87d02d8b-b9ed-41b3-b684-bbfc96f72357" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "cinder-quobyte-87d02d8b-b9ed-41b3-b684-bbfc96f72357" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b643991-e218-45e3-b7a7-f0393ac5ae62]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:29 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 Jul 07 22:33:29 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[535394ea-58dc-45cf-bb9c-8a43c829c034]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:29 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac Jul 07 22:33:29 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:30 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357" returned: 0 in 1.215s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:30 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357 Jul 07 22:33:30 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:31 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac" returned: 0 in 1.178s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.203s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-00fdd864-12e2-4311-9b7c-e87acfa784ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fcc2163-ec9b-4b42-8cff-010d296db665', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:33:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-df850087-b8ff-433c-8369-e3647e71b346 req-2c44cb4a-2759-46a3-a0eb-5590edb85f90 tempest-ServerActionsTestOtherA-1636264360 None] attachment_update completed successfully. Jul 07 22:33:31 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-87d02d8b-b9ed-41b3-b684-bbfc96f72357" returned: 0 in 1.132s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "cinder-quobyte-87d02d8b-b9ed-41b3-b684-bbfc96f72357" released by "delete_volume" :: held 2.406s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Created reservations ['18a20177-895d-465b-9e5d-41b6195ff960', '2d069b1d-b0c4-40a7-84d2-f677aa6997cd', '0c2c2dcf-a063-4cc3-80f8-fa501c474fb1', 'dcc24c53-83df-4f80-8e33-ed1f2ec7f697'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:31 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:33:31 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:32 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:32 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:32 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Deleted volume successfully. Jul 07 22:33:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-36ff08da-d839-496f-b44d-03afbc538033 tempest-DeleteServersTestJSON-1437557451 None] Lock "cinder-87d02d8b-b9ed-41b3-b684-bbfc96f72357-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Flow 'volume_create_manager' (4835a978-f658-4128-a498-9f0bdc0ce75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22db9244-73ae-4144-ab2f-60b34c3f5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22db9244-73ae-4144-ab2f-60b34c3f5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1220266663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8005246d-a5ae-4877-94c2-0c0a515261bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8be9ec8ee54b879f6e41dfc1de9c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:37Z,use_quota=True,user_id='4bb0184d26484505bee84dc61cf6c2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa01f02c-4eb7-42bc-946b-460086949b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa01f02c-4eb7-42bc-946b-460086949b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a227c2-9a2b-40e5-9070-81d9f06f7e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a227c2-9a2b-40e5-9070-81d9f06f7e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8005246d-a5ae-4877-94c2-0c0a515261bc', 'volume_name': 'volume-8005246d-a5ae-4877-94c2-0c0a515261bc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44899767-9660-432a-8372-b2de8336f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44899767-9660-432a-8372-b2de8336f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b34c2a-e282-4728-89fe-ac22e1fbb005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Volume 8005246d-a5ae-4877-94c2-0c0a515261bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8005246d-a5ae-4877-94c2-0c0a515261bc', 'volume_size': 1} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1220266663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8005246d-a5ae-4877-94c2-0c0a515261bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8be9ec8ee54b879f6e41dfc1de9c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:37Z,use_quota=True,user_id='4bb0184d26484505bee84dc61cf6c2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Creating volume 8005246d-a5ae-4877-94c2-0c0a515261bc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:36 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:33:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:36 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc 1073741824 Jul 07 22:33:36 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:38 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc 1073741824" returned: 0 in 1.229s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:38 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc Jul 07 22:33:38 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:39 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc" returned: 0 in 0.952s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b34c2a-e282-4728-89fe-ac22e1fbb005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8005246d-a5ae-4877-94c2-0c0a515261bc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4743307f-03e5-44f1-a036-c6ed05c233d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:39 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Volume volume-8005246d-a5ae-4877-94c2-0c0a515261bc (8005246d-a5ae-4877-94c2-0c0a515261bc): created successfully Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4743307f-03e5-44f1-a036-c6ed05c233d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Flow 'volume_create_manager' (4835a978-f658-4128-a498-9f0bdc0ce75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b62504f3-7d9b-4bcb-afa7-07b36c0d9ae1 tempest-TaggedAttachmentsTest-599560541 None] Created volume successfully. Jul 07 22:33:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-0f0622ab-24f1-489b-903d-682dc0139b73 tempest-ServerActionsTestOtherA-1636264360 None] Terminate volume connection completed successfully. Jul 07 22:33:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-0f0622ab-24f1-489b-903d-682dc0139b73 tempest-ServerActionsTestOtherA-1636264360 None] Deleting attachment 2fcc2163-ec9b-4b42-8cff-010d296db665. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:33:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-0993aef0-15f9-474f-8bc1-afd081eee99a req-f432ddd0-80b2-45a0-b5c0-05648022ba67 tempest-AttachVolumeTestJSON-1576231458 None] Terminate volume connection completed successfully. Jul 07 22:33:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-0993aef0-15f9-474f-8bc1-afd081eee99a req-f432ddd0-80b2-45a0-b5c0-05648022ba67 tempest-AttachVolumeTestJSON-1576231458 None] Deleting attachment 318f13ef-3ca9-443a-b70f-147bed440b98. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:33:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccaa0e3-eead-48ba-b95d-a1573cd1de28]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:42 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac Jul 07 22:33:42 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:43 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac" returned: 0 in 1.085s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.107s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-00fdd864-12e2-4311-9b7c-e87acfa784ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4884fa70-0b5d-4fe9-9ec7-fcd44756a3c6', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:33:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b8169b05-b1d2-4bba-aa7a-580ed14269c2 req-e8321ae6-7667-40af-a139-1d555aa95799 tempest-ServerActionsTestOtherA-1636264360 None] attachment_update completed successfully. Jul 07 22:33:53 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=32,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:33:53 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=1,cinder:SELECT=25 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:15 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:34:15 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:16 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.423s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:34:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 8 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:34:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:34:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-78e98cae-c573-4529-ab86-74df1d21a2fd req-91da9915-45fa-4acc-a6ac-9c2958f0897f tempest-ServerActionsTestOtherA-1636264360 None] Terminate volume connection completed successfully. Jul 07 22:34:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-78e98cae-c573-4529-ab86-74df1d21a2fd req-91da9915-45fa-4acc-a6ac-9c2958f0897f tempest-ServerActionsTestOtherA-1636264360 None] Deleting attachment 4884fa70-0b5d-4fe9-9ec7-fcd44756a3c6. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:34:32 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:34:32 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "cinder-00fdd864-12e2-4311-9b7c-e87acfa784ac-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "cinder-00fdd864-12e2-4311-9b7c-e87acfa784ac-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "cinder-quobyte-00fdd864-12e2-4311-9b7c-e87acfa784ac" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "cinder-quobyte-00fdd864-12e2-4311-9b7c-e87acfa784ac" acquired by "delete_volume" :: waited 0.059s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5970670d-b218-4512-90a8-a96a576f07e4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:36 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac Jul 07 22:34:36 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:36 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac" returned: 0 in 1.334s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:37 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac Jul 07 22:34:37 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:38 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00fdd864-12e2-4311-9b7c-e87acfa784ac" returned: 0 in 1.066s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "cinder-quobyte-00fdd864-12e2-4311-9b7c-e87acfa784ac" released by "delete_volume" :: held 2.488s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Created reservations ['96038d5e-8197-449d-a55b-5ca8c754c10d', 'efced1d2-ab40-4ba6-8ae2-3ab2234ba064', '9d1d412e-b7bc-42d8-a446-f393ba9ba85e', '01e7ed2b-d08d-423c-829f-ecb20e1ec90f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:38 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:34:38 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:39 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.104s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:39 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Deleted volume successfully. Jul 07 22:34:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0c0f42bb-6122-42ce-a469-32a04de76e7c tempest-ServerActionsTestOtherA-1636264360 None] Lock "cinder-00fdd864-12e2-4311-9b7c-e87acfa784ac-delete_volume" released by "delete_volume" :: held 4.177s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:40 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Flow 'volume_create_manager' (9100111f-6c0e-436c-aec7-ad769bf34573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b937a2-f12a-47e5-baa2-614418a59f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b937a2-f12a-47e5-baa2-614418a59f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-394739713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2866128c-90ad-4c84-81e1-8ea0d0ef1d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11564e0f7b554612b4d3a59c0746af59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:41Z,use_quota=True,user_id='a9724f7225304631805356f8df450766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab638bb-7a0c-451e-bb58-8fcbdebdafcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab638bb-7a0c-451e-bb58-8fcbdebdafcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d464ec0-d314-43d5-8c01-a8187ef76faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d464ec0-d314-43d5-8c01-a8187ef76faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2866128c-90ad-4c84-81e1-8ea0d0ef1d5f', 'volume_name': 'volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3331b752-8e11-4781-a211-443bede27d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3331b752-8e11-4781-a211-443bede27d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ba71e-c2d1-4b25-a2d4-2981e1d28dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Volume 2866128c-90ad-4c84-81e1-8ea0d0ef1d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f', 'volume_size': 1} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-394739713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2866128c-90ad-4c84-81e1-8ea0d0ef1d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11564e0f7b554612b4d3a59c0746af59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:41Z,use_quota=True,user_id='a9724f7225304631805356f8df450766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Creating volume 2866128c-90ad-4c84-81e1-8ea0d0ef1d5f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:34:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:41 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f 1073741824 Jul 07 22:34:41 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:43 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f 1073741824" returned: 0 in 2.055s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:43 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f Jul 07 22:34:43 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:44 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" returned: 0 in 1.130s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] <== create_volume: return (3253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.255s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ba71e-c2d1-4b25-a2d4-2981e1d28dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ade8be4-c4de-49e0-8a6a-79a140685b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Volume volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f (2866128c-90ad-4c84-81e1-8ea0d0ef1d5f): created successfully Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ade8be4-c4de-49e0-8a6a-79a140685b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Flow 'volume_create_manager' (9100111f-6c0e-436c-aec7-ad769bf34573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0999c508-1b7a-4c30-844c-ec90b710f99a tempest-ServerRescueNegativeTestJSON-1929072266 None] Created volume successfully. Jul 07 22:34:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a35a8-9886-4463-8ad2-c0a8bc8ca2ab]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:53 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc Jul 07 22:34:53 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:55 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc" returned: 0 in 1.194s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.224s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-8005246d-a5ae-4877-94c2-0c0a515261bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9db11cd9-d275-4724-84f3-2a713dc1b17a', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:34:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-e7ebcdf7-8a98-4ea7-b264-4d9c18862edc req-0e89ca41-9e72-4c14-b1d4-7afeafdbde3d tempest-TaggedAttachmentsTest-599560541 None] attachment_update completed successfully. Jul 07 22:35:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-6ee32141-7f2c-4ad0-9dfb-ab0a3d98c7f5 req-f11d4c51-1b8b-4510-830f-ce62bf19673f tempest-TaggedAttachmentsTest-599560541 None] Terminate volume connection completed successfully. Jul 07 22:35:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-6ee32141-7f2c-4ad0-9dfb-ab0a3d98c7f5 req-f11d4c51-1b8b-4510-830f-ce62bf19673f tempest-TaggedAttachmentsTest-599560541 None] Deleting attachment 9db11cd9-d275-4724-84f3-2a713dc1b17a. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:35:05 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=15,cinder:SELECT=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Acquiring lock "cinder-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "cinder-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Acquiring lock "cinder-quobyte-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "cinder-quobyte-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" acquired by "delete_volume" :: waited 0.051s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2101a058-f89a-46dc-9a2b-550b31232408]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:07 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f Jul 07 22:35:07 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:08 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" returned: 0 in 1.436s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:09 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f Jul 07 22:35:09 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:10 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" returned: 0 in 1.329s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "cinder-quobyte-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f" released by "delete_volume" :: held 2.870s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Created reservations ['6459f4f2-a3f8-4aab-ad3c-d6ec12b3d680', 'a583900b-6e66-4ea8-8261-a0188b24d88b', 'cabbb7f0-9770-415d-a4ce-9b8f6697b52f', '454b85c0-c1de-407f-a200-ab05c26352b9'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:10 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:35:10 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:11 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.398s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:11 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Deleted volume successfully. Jul 07 22:35:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68337120-86ff-4165-bafa-d94d78c1d551 tempest-ServerRescueNegativeTestJSON-1929072266 None] Lock "cinder-2866128c-90ad-4c84-81e1-8ea0d0ef1d5f-delete_volume" released by "delete_volume" :: held 4.867s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:15 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:35:15 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:16 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.009s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:35:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 8 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:35:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:35:20 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:35:21 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (bdae4cb9-e623-48f8-bd33-1781b439a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0ef97-71bc-4364-90b3-6caa8519fdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0ef97-71bc-4364-90b3-6caa8519fdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098704379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f5ab17-20c8-4b29-9e4c-ffcc6584ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f5ab17-20c8-4b29-9e4c-ffcc6584ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d983c04-93ae-406f-8fb5-bde3f09b1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d983c04-93ae-406f-8fb5-bde3f09b1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1', 'volume_name': 'volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab44715-3278-43af-90d5-27ab6c6add44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab44715-3278-43af-90d5-27ab6c6add44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa2530-9955-4d2c-b8a8-9ccd04a30944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Volume 2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1', 'volume_size': 1} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098704379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Creating volume 2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:22 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:35:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:22 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 1073741824 Jul 07 22:35:22 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:23 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 1073741824" returned: 0 in 1.029s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:24 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 Jul 07 22:35:24 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:24 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa2530-9955-4d2c-b8a8-9ccd04a30944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1024e4c-ac2e-4cb4-841d-3d71f2ddefdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:24 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Volume volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 (2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1): created successfully Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1024e4c-ac2e-4cb4-841d-3d71f2ddefdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (bdae4cb9-e623-48f8-bd33-1781b439a68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c00096ab-9a93-4d5b-bf11-b5777b20ef31 tempest-AttachVolumeTestJSON-1576231458 None] Created volume successfully. Jul 07 22:35:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "cinder-8005246d-a5ae-4877-94c2-0c0a515261bc-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "cinder-8005246d-a5ae-4877-94c2-0c0a515261bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "cinder-quobyte-8005246d-a5ae-4877-94c2-0c0a515261bc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "cinder-quobyte-8005246d-a5ae-4877-94c2-0c0a515261bc" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:26 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1e738-0cf5-45a8-a17c-84e304d7cefd]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:26 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc Jul 07 22:35:26 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:27 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc" returned: 0 in 1.164s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:27 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc Jul 07 22:35:27 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:28 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7790a935-8c18-463f-a461-ec53a642e560]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8005246d-a5ae-4877-94c2-0c0a515261bc" returned: 0 in 1.113s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "cinder-quobyte-8005246d-a5ae-4877-94c2-0c0a515261bc" released by "delete_volume" :: held 2.357s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Created reservations ['3153a64e-4901-48b5-9b5d-e3d8c8e506f4', '0e3f22d3-d6ca-4cd2-bf6f-cae2c7d827c3', 'bbe3d230-3c2d-49c2-809e-bd5b6dab3e42', '14f86597-44cb-4b8b-9f10-e9116e50deac'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:28 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 Jul 07 22:35:28 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:28 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:35:28 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:29 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" returned: 0 in 0.920s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5b7703e-a0ff-4eeb-9b01-f75ad4b2efb0', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:35:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-e5133389-2b5c-4fed-98ed-a1813d0cb6f0 req-c82af414-5492-4296-8636-e9f980c3cee3 tempest-AttachVolumeTestJSON-1576231458 None] attachment_update completed successfully. Jul 07 22:35:29 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Deleted volume successfully. Jul 07 22:35:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e8339522-45a1-4afc-afca-66fecb6fcf06 tempest-TaggedAttachmentsTest-599560541 None] Lock "cinder-8005246d-a5ae-4877-94c2-0c0a515261bc-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (fddcb2ba-a8a4-48f9-b0f4-0c15462df937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74da67cf-a408-4b8c-865a-38d746bd833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74da67cf-a408-4b8c-865a-38d746bd833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1586279597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb3666c-6fea-457c-9fed-b13df48501b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:35Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b9faf8-cc4b-4c5e-91af-ca98d0a78b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b9faf8-cc4b-4c5e-91af-ca98d0a78b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571885b4-3394-4fac-b773-4a2e3c6ee2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571885b4-3394-4fac-b773-4a2e3c6ee2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb3666c-6fea-457c-9fed-b13df48501b7', 'volume_name': 'volume-8fb3666c-6fea-457c-9fed-b13df48501b7', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17983c97-910a-4c3e-8b2f-01a6c5e8c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17983c97-910a-4c3e-8b2f-01a6c5e8c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e51a85-98b2-4f85-b616-b1fe5b330470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Volume 8fb3666c-6fea-457c-9fed-b13df48501b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb3666c-6fea-457c-9fed-b13df48501b7', 'volume_size': 1} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1586279597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb3666c-6fea-457c-9fed-b13df48501b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2fee36b9404c18b804855bd77abc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:35Z,use_quota=True,user_id='bc8d141cd69b4f00a8f97df24f9b0402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Creating volume 8fb3666c-6fea-457c-9fed-b13df48501b7 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:35 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:35:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:35 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 1073741824 Jul 07 22:35:35 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:37 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 1073741824" returned: 0 in 1.176s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:37 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 Jul 07 22:35:37 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Flow 'volume_create_manager' (ecc77b07-c598-4c41-bb46-aa167984eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b0a264-9c0b-4ccc-a875-eb614bd1f0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b0a264-9c0b-4ccc-a875-eb614bd1f0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1647162479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18cc4e5-6db8-4b59-bd21-57fff22faefa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88bd5fe5b32b484db0be86e3178b0824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:38Z,use_quota=True,user_id='59ddb72fa31c427393015be2baf6b5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ee3931-e582-4673-a073-2eedeea968ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ee3931-e582-4673-a073-2eedeea968ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e743c-d05b-4c2d-b5a2-7de2222cd66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e743c-d05b-4c2d-b5a2-7de2222cd66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18cc4e5-6db8-4b59-bd21-57fff22faefa', 'volume_name': 'volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f8602-bd00-4ed2-b4d6-71cb02781383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f8602-bd00-4ed2-b4d6-71cb02781383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9a6760-bf45-4875-b0b1-667370a249ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:38 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Volume b18cc4e5-6db8-4b59-bd21-57fff22faefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa', 'volume_size': 1} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:38 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7" returned: 0 in 1.229s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.484s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1647162479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18cc4e5-6db8-4b59-bd21-57fff22faefa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88bd5fe5b32b484db0be86e3178b0824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:38Z,use_quota=True,user_id='59ddb72fa31c427393015be2baf6b5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Creating volume b18cc4e5-6db8-4b59-bd21-57fff22faefa {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:38 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:38 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa 1073741824 Jul 07 22:35:38 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e51a85-98b2-4f85-b616-b1fe5b330470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb3666c-6fea-457c-9fed-b13df48501b7', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21283258-2618-4a1f-bcd7-b7a82e80004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:38 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Volume volume-8fb3666c-6fea-457c-9fed-b13df48501b7 (8fb3666c-6fea-457c-9fed-b13df48501b7): created successfully Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21283258-2618-4a1f-bcd7-b7a82e80004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Flow 'volume_create_manager' (fddcb2ba-a8a4-48f9-b0f4-0c15462df937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:38 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d361ed9d-1477-47d8-8e89-c8e46fd9bd99 tempest-AttachVolumeTestJSON-1576231458 None] Created volume successfully. Jul 07 22:35:39 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa 1073741824" returned: 0 in 1.544s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:39 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa Jul 07 22:35:40 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:41 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa" returned: 0 in 1.136s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] <== create_volume: return (2756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.759s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9a6760-bf45-4875-b0b1-667370a249ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c3ebbf-ddcd-4864-9a36-80bd7a26e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Volume volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa (b18cc4e5-6db8-4b59-bd21-57fff22faefa): created successfully Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c3ebbf-ddcd-4864-9a36-80bd7a26e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Flow 'volume_create_manager' (ecc77b07-c598-4c41-bb46-aa167984eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-022d0751-f288-4000-9238-b3d01e4b3fb0 req-4838bf35-5caa-4707-9f95-10696b0aed2f tempest-VolumesGetTestJSON-1969246903 None] Created volume successfully. Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Acquiring lock "cinder-b18cc4e5-6db8-4b59-bd21-57fff22faefa-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "cinder-b18cc4e5-6db8-4b59-bd21-57fff22faefa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Acquiring lock "cinder-quobyte-b18cc4e5-6db8-4b59-bd21-57fff22faefa" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "cinder-quobyte-b18cc4e5-6db8-4b59-bd21-57fff22faefa" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd8038-21c9-44e0-bd21-d6e015780a5f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:42 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa Jul 07 22:35:42 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b6ff2-684a-429c-8185-be69fc1c099b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:42 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 Jul 07 22:35:42 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:43 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa" returned: 0 in 1.438s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:43 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa Jul 07 22:35:43 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:43 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7" returned: 0 in 1.103s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.160s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-8fb3666c-6fea-457c-9fed-b13df48501b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5925d96-b6b2-46a1-aab4-e18bacd52479', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:35:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b43fde5c-8c03-471f-960d-bc84667bc739 req-b7c85186-ba81-4685-b812-9c1a7c864d62 tempest-AttachVolumeTestJSON-1576231458 None] attachment_update completed successfully. Jul 07 22:35:44 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b18cc4e5-6db8-4b59-bd21-57fff22faefa" returned: 0 in 1.129s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "cinder-quobyte-b18cc4e5-6db8-4b59-bd21-57fff22faefa" released by "delete_volume" :: held 2.631s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG cinder.quota [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Created reservations ['24fc07a1-f17b-4a48-a27e-ee102c768b0c', '74d5ee3e-2fe1-4cd1-8094-8330710a8f63', '7edec498-19f3-4759-9a74-311e2bdcced4', '57dd640b-9297-4931-b1c7-8b7a3ecad489'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:44 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:35:44 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:45 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:45 devstack cinder-volume[88087]: DEBUG cinder.manager [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Deleted volume successfully. Jul 07 22:35:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c870097a-735f-4acc-a89a-e4718938b6b0 req-18bdbfb6-50cf-4845-bd38-647ba43a2e44 tempest-VolumesGetTestJSON-1969246903 None] Lock "cinder-b18cc4e5-6db8-4b59-bd21-57fff22faefa-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b71c3f76-9cfa-4432-91c1-a14ea350d695 req-33315eb7-af6e-4158-a01d-e412dd9bc8b3 tempest-AttachVolumeTestJSON-1576231458 None] Terminate volume connection completed successfully. Jul 07 22:35:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b71c3f76-9cfa-4432-91c1-a14ea350d695 req-33315eb7-af6e-4158-a01d-e412dd9bc8b3 tempest-AttachVolumeTestJSON-1576231458 None] Deleting attachment c5b7703e-a0ff-4eeb-9b01-f75ad4b2efb0. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (f3fae668-d220-4037-832d-cbc47d13f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf592ef-9605-4921-a3df-e6fb2ccab7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf592ef-9605-4921-a3df-e6fb2ccab7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091312760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16ccd51-27b4-4cba-b6f5-ca48875dfacc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:53Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48fd9ac-b9ac-4812-a7ba-356d1b675a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48fd9ac-b9ac-4812-a7ba-356d1b675a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcef91a-2055-4125-b69d-abf094cfbd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcef91a-2055-4125-b69d-abf094cfbd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16ccd51-27b4-4cba-b6f5-ca48875dfacc', 'volume_name': 'volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31a8ef3-200c-4b0c-bc18-fdbeecee7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31a8ef3-200c-4b0c-bc18-fdbeecee7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1300e0e1-ffea-46d4-9efd-f263dea85c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Volume b16ccd51-27b4-4cba-b6f5-ca48875dfacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc', 'volume_size': 1} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091312760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16ccd51-27b4-4cba-b6f5-ca48875dfacc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:53Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Creating volume b16ccd51-27b4-4cba-b6f5-ca48875dfacc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:35:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:53 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc 1073741824 Jul 07 22:35:53 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:54 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc 1073741824" returned: 0 in 1.041s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:54 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc Jul 07 22:35:54 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-ca61db78-f9a0-4318-ab34-9294a5502392 req-7b5b8d4f-08f8-43ba-b402-ec27fc60ddaa tempest-AttachVolumeTestJSON-1576231458 None] Terminate volume connection completed successfully. Jul 07 22:35:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-ca61db78-f9a0-4318-ab34-9294a5502392 req-7b5b8d4f-08f8-43ba-b402-ec27fc60ddaa tempest-AttachVolumeTestJSON-1576231458 None] Deleting attachment d5925d96-b6b2-46a1-aab4-e18bacd52479. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:35:55 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" returned: 0 in 0.821s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1300e0e1-ffea-46d4-9efd-f263dea85c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9453f2e6-d19d-4c91-a8ee-1bc5a60d0f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Volume volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc (b16ccd51-27b4-4cba-b6f5-ca48875dfacc): created successfully Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9453f2e6-d19d-4c91-a8ee-1bc5a60d0f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (f3fae668-d220-4037-832d-cbc47d13f2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-80be6df1-158e-4745-8ae6-5c894de8a86f tempest-VolumesTestJSON-1224964017 None] Created volume successfully. Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (143ef8a5-de78-44d2-ad43-f7a533589765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f8ed17-ee0e-45dd-99c6-84e17f93d9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f8ed17-ee0e-45dd-99c6-84e17f93d9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1907453836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5848ff68-68f9-47a0-bbe4-a110a9fd357f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:57Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e08c757-10cf-4286-adf5-658631c63081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e08c757-10cf-4286-adf5-658631c63081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a60851-e085-487b-b6f5-5c6cd4fabf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a60851-e085-487b-b6f5-5c6cd4fabf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5848ff68-68f9-47a0-bbe4-a110a9fd357f', 'volume_name': 'volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8bd484-73fd-4109-9f42-108808705865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8bd484-73fd-4109-9f42-108808705865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6000d57e-2f50-413f-9fd2-b265c80b5fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Volume 5848ff68-68f9-47a0-bbe4-a110a9fd357f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f', 'volume_size': 1} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1907453836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5848ff68-68f9-47a0-bbe4-a110a9fd357f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:57Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Creating volume 5848ff68-68f9-47a0-bbe4-a110a9fd357f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:57 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:35:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:57 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f 1073741824 Jul 07 22:35:57 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:58 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f 1073741824" returned: 0 in 1.475s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:58 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f Jul 07 22:35:58 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:59 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f" returned: 0 in 1.327s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.874s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6000d57e-2f50-413f-9fd2-b265c80b5fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec7d4a-be8e-4496-8dfe-b38cbdae60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Volume volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f (5848ff68-68f9-47a0-bbe4-a110a9fd357f): created successfully Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec7d4a-be8e-4496-8dfe-b38cbdae60cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (143ef8a5-de78-44d2-ad43-f7a533589765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fc80d800-aad5-4e08-aad3-783313036326 tempest-VolumesTestJSON-1224964017 None] Created volume successfully. Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (b21f01cd-b6c4-4d61-9777-8b56f25ac025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01feb59-bd65-487d-a041-754f901e7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01feb59-bd65-487d-a041-754f901e7606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2147310148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b745ec69-040e-48cb-8114-9dfdeaa59021,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:02Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86f0d4d-b182-4ca0-8b8e-d099a297c1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86f0d4d-b182-4ca0-8b8e-d099a297c1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c2f46a-cdd8-4e00-82c8-50feba43e7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c2f46a-cdd8-4e00-82c8-50feba43e7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b745ec69-040e-48cb-8114-9dfdeaa59021', 'volume_name': 'volume-b745ec69-040e-48cb-8114-9dfdeaa59021', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae4311c-ff7e-4d42-8b04-f9073bc3222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae4311c-ff7e-4d42-8b04-f9073bc3222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d6b23d-199c-4cfc-9465-a1abd213d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Volume b745ec69-040e-48cb-8114-9dfdeaa59021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b745ec69-040e-48cb-8114-9dfdeaa59021', 'volume_size': 1} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2147310148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b745ec69-040e-48cb-8114-9dfdeaa59021,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ab4b6db384c53b36222480e795f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:02Z,use_quota=True,user_id='0b1265a22e974cc5a75917f52bf96720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Creating volume b745ec69-040e-48cb-8114-9dfdeaa59021 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:02 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:02 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 1073741824 Jul 07 22:36:02 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:03 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 1073741824" returned: 0 in 1.545s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:03 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 Jul 07 22:36:03 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:05 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021" returned: 0 in 1.178s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] <== create_volume: return (2825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.835s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d6b23d-199c-4cfc-9465-a1abd213d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b745ec69-040e-48cb-8114-9dfdeaa59021', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f6269b-1a6a-434f-be7f-92aaed554cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:05 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Volume volume-b745ec69-040e-48cb-8114-9dfdeaa59021 (b745ec69-040e-48cb-8114-9dfdeaa59021): created successfully Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f6269b-1a6a-434f-be7f-92aaed554cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Flow 'volume_create_manager' (b21f01cd-b6c4-4d61-9777-8b56f25ac025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f68b7e4c-20ad-48c0-a26a-f826ca619ffc tempest-VolumesTestJSON-1224964017 None] Created volume successfully. Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-8fb3666c-6fea-457c-9fed-b13df48501b7-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-8fb3666c-6fea-457c-9fed-b13df48501b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-quobyte-8fb3666c-6fea-457c-9fed-b13df48501b7" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-8fb3666c-6fea-457c-9fed-b13df48501b7" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c7ce8-820c-49db-8d24-458356b6cb61]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:06 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 Jul 07 22:36:06 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-b745ec69-040e-48cb-8114-9dfdeaa59021-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "cinder-b745ec69-040e-48cb-8114-9dfdeaa59021-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-quobyte-b745ec69-040e-48cb-8114-9dfdeaa59021" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-b745ec69-040e-48cb-8114-9dfdeaa59021" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:07 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7" returned: 0 in 1.045s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ea386-2052-4d20-a0f5-3db7526158d9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:07 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7 Jul 07 22:36:07 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:07 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 Jul 07 22:36:07 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:08 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fb3666c-6fea-457c-9fed-b13df48501b7" returned: 0 in 0.722s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-8fb3666c-6fea-457c-9fed-b13df48501b7" released by "delete_volume" :: held 1.825s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Created reservations ['0fbdd850-f64c-47bd-ad44-606fa0661d35', '09297013-bd7b-474d-9b70-588e3c45cfdf', '836c92c7-7946-48ec-95d0-db8a4efe6ae2', 'a3c39c8f-61ed-4ed9-82ee-c30310309707'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:08 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:08 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021" returned: 0 in 0.915s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:08 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:08 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021 Jul 07 22:36:08 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-quobyte-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e738470e-8c24-4e83-8d01-57448214891d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:08 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 Jul 07 22:36:08 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:09 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.944s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:09 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Deleted volume successfully. Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a06f5da3-9450-4399-883b-07897c941dd8 tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-8fb3666c-6fea-457c-9fed-b13df48501b7-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:09 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b745ec69-040e-48cb-8114-9dfdeaa59021" returned: 0 in 1.039s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-b745ec69-040e-48cb-8114-9dfdeaa59021" released by "delete_volume" :: held 2.022s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Created reservations ['be37436f-e5a9-462f-b45a-651fb8b266c1', '1fcfe605-be82-49bb-8f5a-6da8490de99b', '875ff678-833c-4f5f-9966-e45b571fbe6e', '9182138b-39b5-41db-8ce5-492aa3c750a6'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-5848ff68-68f9-47a0-bbe4-a110a9fd357f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:09 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:09 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "cinder-5848ff68-68f9-47a0-bbe4-a110a9fd357f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-quobyte-5848ff68-68f9-47a0-bbe4-a110a9fd357f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-5848ff68-68f9-47a0-bbe4-a110a9fd357f" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7a079-841b-4bcf-9cb5-4a437aade1a5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:10 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f Jul 07 22:36:10 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:10 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" returned: 0 in 1.392s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:10 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1 Jul 07 22:36:10 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Flow 'volume_create_manager' (3da15a8e-5a5c-4762-843c-4260de45f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e12be2-93e7-4c7b-803c-373f73636313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e12be2-93e7-4c7b-803c-373f73636313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-23867315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3feb932162874bd2a406e73584c4da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:10Z,use_quota=True,user_id='aed2bad6dbfc462e88159df1f53ac47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a9411-541a-4365-a97f-48872ec0a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a9411-541a-4365-a97f-48872ec0a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9bc354-deae-425f-bad2-47980a91d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9bc354-deae-425f-bad2-47980a91d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86', 'volume_name': 'volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176cc027-ead4-4cf4-be64-ff43030f319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176cc027-ead4-4cf4-be64-ff43030f319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3b0c21-94c1-4bfd-ae99-f52ac00b8a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:10 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Volume 042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86', 'volume_size': 1} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-23867315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3feb932162874bd2a406e73584c4da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:10Z,use_quota=True,user_id='aed2bad6dbfc462e88159df1f53ac47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Creating volume 042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:10 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:10 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 1073741824 Jul 07 22:36:10 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:10 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.125s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Deleted volume successfully. Jul 07 22:36:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-800fa25d-2e8c-4104-a66e-ecbc009a6e92 tempest-VolumesTestJSON-1224964017 None] Lock "cinder-b745ec69-040e-48cb-8114-9dfdeaa59021-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:11 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" returned: 0 in 0.995s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1" released by "delete_volume" :: held 2.459s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:11 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f" returned: 0 in 1.299s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:11 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f Jul 07 22:36:11 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Created reservations ['a95cf7d1-8ed2-4542-a5b0-a0571e32f766', '8b738a9b-2c58-43aa-9b76-100191c08156', 'd31410d3-ffaf-44cc-ad55-f9ab20f35cac', '4e055354-dc39-48cb-889e-065496e81e46'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:11 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:11 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:11 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 1073741824" returned: 0 in 1.100s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:11 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 Jul 07 22:36:11 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:12 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5848ff68-68f9-47a0-bbe4-a110a9fd357f" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-5848ff68-68f9-47a0-bbe4-a110a9fd357f" released by "delete_volume" :: held 2.195s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Created reservations ['c4a53f6e-7c89-420a-859d-a09dff8b01ae', '17bce6e2-0fa4-49cd-8e3d-f912c1bd2658', '2c7ff8a5-fd82-41b0-ac1a-4a30a05d367e', 'e8841b4d-5825-4df3-8bcd-86a711d72a06'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-28b0d03e-ff61-456b-8880-93f4d01c7d6f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-28b0d03e-ff61-456b-8880-93f4d01c7d6f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:12 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Deleted volume successfully. Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:12 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:12 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ab4807d-9d56-4738-9e09-7dbb4a5326df tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-2bbd9bf1-47d9-4894-a0c6-2384b0bf29a1-delete_volume" released by "delete_volume" :: held 3.847s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "cinder-quobyte-28b0d03e-ff61-456b-8880-93f4d01c7d6f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-28b0d03e-ff61-456b-8880-93f4d01c7d6f" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62249d3-a0bf-4855-9e79-e599f3e924b8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:12 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" returned: 0 in 0.850s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3b0c21-94c1-4bfd-ae99-f52ac00b8a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3110783c-a16c-4ceb-a806-e7340de0ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Volume volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 (042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86): created successfully Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3110783c-a16c-4ceb-a806-e7340de0ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f Jul 07 22:36:12 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Flow 'volume_create_manager' (3da15a8e-5a5c-4762-843c-4260de45f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1b7ea509-87cb-40ed-9c1e-cdea80782974 tempest-ServersNegativeTestJSON-878415144 None] Created volume successfully. Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-b16ccd51-27b4-4cba-b6f5-ca48875dfacc-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:13 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.732s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "cinder-b16ccd51-27b4-4cba-b6f5-ca48875dfacc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:13 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Deleted volume successfully. Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-95ae6d80-008a-409a-a632-8f747ad4ca6a tempest-VolumesTestJSON-1224964017 None] Lock "cinder-5848ff68-68f9-47a0-bbe4-a110a9fd357f-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Acquiring lock "cinder-quobyte-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6910ee-2b95-4db7-8201-e047884c2b93]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:13 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc Jul 07 22:36:13 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:13 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f" returned: 0 in 0.815s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:13 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f Jul 07 22:36:13 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:14 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28b0d03e-ff61-456b-8880-93f4d01c7d6f" returned: 0 in 0.711s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-quobyte-28b0d03e-ff61-456b-8880-93f4d01c7d6f" released by "delete_volume" :: held 1.614s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:14 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" returned: 0 in 0.894s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:14 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc Jul 07 22:36:14 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Created reservations ['44eac245-7aea-4bb3-ba7f-a5c9dbf40262', 'f8831ec5-2b95-499b-8bf0-49cc28c126a2', '320c61a0-bca2-421d-ae87-ac77722cf985', '4c6e68f6-e312-4c42-8d5e-69c46faa887b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:14 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:14 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:15 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "cinder-quobyte-b16ccd51-27b4-4cba-b6f5-ca48875dfacc" released by "delete_volume" :: held 1.818s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Created reservations ['e676cf45-f243-40b4-9f94-e9c6b8f2f714', '9a3e816a-5f0b-409b-befb-3033d72fd301', 'ba9cec84-2287-4190-aa11-baeca4b40ce8', '4796d87e-81f1-4fcb-886e-fbed2790cb4f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:15 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.884s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Deleted volume successfully. Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d1674996-d12f-413c-8eb9-3f232c55e07d tempest-AttachVolumeTestJSON-1576231458 None] Lock "cinder-28b0d03e-ff61-456b-8880-93f4d01c7d6f-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:15 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:15 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:15 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:15 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Flow 'volume_create_manager' (a1c7ee95-fbee-4a99-8897-647aa260d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf96898-ba2c-4b94-b1bf-0e2eddc11d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf96898-ba2c-4b94-b1bf-0e2eddc11d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-92885169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3feb932162874bd2a406e73584c4da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:16Z,use_quota=True,user_id='aed2bad6dbfc462e88159df1f53ac47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30e43fe-92cd-4a9e-90d8-362cf58da1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30e43fe-92cd-4a9e-90d8-362cf58da1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a9a64e-09ea-4a9f-ba40-46d15d2842a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a9a64e-09ea-4a9f-ba40-46d15d2842a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3', 'volume_name': 'volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbf453f-fcf5-493b-90c8-087e617a93da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbf453f-fcf5-493b-90c8-087e617a93da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5478b7-347a-4c65-a17c-48bcd46ae146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Volume 8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3', 'volume_size': 1} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-92885169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3feb932162874bd2a406e73584c4da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:16Z,use_quota=True,user_id='aed2bad6dbfc462e88159df1f53ac47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Creating volume 8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:16 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:16 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 1073741824 Jul 07 22:36:16 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:16 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.221s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Deleted volume successfully. Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-54d99aff-f084-4d55-88ba-efcbfc6b306c tempest-VolumesTestJSON-1224964017 None] Lock "cinder-b16ccd51-27b4-4cba-b6f5-ca48875dfacc-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:16 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.468s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 8 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:36:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:36:17 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 1073741824" returned: 0 in 1.404s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:17 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 Jul 07 22:36:17 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:18 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" returned: 0 in 0.927s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] <== create_volume: return (2409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5478b7-347a-4c65-a17c-48bcd46ae146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db863fe7-b1b7-4644-847b-03462fb8a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Volume volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 (8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3): created successfully Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db863fe7-b1b7-4644-847b-03462fb8a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Flow 'volume_create_manager' (a1c7ee95-fbee-4a99-8897-647aa260d991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fb5bf6a3-1491-4129-8924-33b918fbd33a tempest-ServersNegativeTestJSON-878415144 None] Created volume successfully. Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "cinder-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "cinder-quobyte-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-quobyte-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" acquired by "delete_volume" :: waited 0.038s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d7b77-7e5b-46b6-94c3-e4549641d699]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:19 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 Jul 07 22:36:19 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:20 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" returned: 0 in 1.069s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:20 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3 Jul 07 22:36:20 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:21 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" returned: 0 in 1.287s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-quobyte-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3" released by "delete_volume" :: held 2.430s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:21 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=98,cinder:SELECT=71,cinder:INSERT=18,cinder:DELETE=9 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=73,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Created reservations ['d0292ca6-c15f-4dc3-880e-ff9327053fc4', '7ca0681a-cd59-4d14-8781-4bb56310d736', '4be4713e-5baf-457c-b1d9-2717f97798b0', 'ab6f35d0-3649-4e6e-9675-af8802e6b505'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:22 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:22 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "cinder-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "cinder-quobyte-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-quobyte-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb70ac3-eff3-48fc-addd-b215b623bb52]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:23 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 Jul 07 22:36:23 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:23 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.397s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Deleted volume successfully. Jul 07 22:36:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8289144b-e954-4a9b-87cb-f39d669c880e tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-8a13ef2d-3cf1-4c1e-8b7f-a733bce393a3-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:24 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" returned: 0 in 1.128s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:24 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86 Jul 07 22:36:24 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:25 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" returned: 0 in 1.020s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-quobyte-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86" released by "delete_volume" :: held 2.241s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Created reservations ['7d9914f6-29aa-4acb-9efc-e9f6aeed4d85', 'b6cb4473-f6d4-4a9f-b1a6-1233b8f6c7e5', '86d583dd-89af-42ac-887a-25ff64f6e7ab', '92dbf858-7a70-4189-a810-052ffac69051'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:25 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:25 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:26 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.418s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:26 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Deleted volume successfully. Jul 07 22:36:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f92f2e9c-88cd-4dd8-9f6e-2fb5e47362d8 tempest-ServersNegativeTestJSON-878415144 None] Lock "cinder-042c3d0c-d5cb-4d8c-bf96-03c17ecd1e86-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Flow 'volume_create_manager' (02109c97-1a87-4dcc-81b8-691791fd1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1453d-c6da-40f0-816f-33167c6681e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1453d-c6da-40f0-816f-33167c6681e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1056259843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a55bd7f-4d99-427a-bea2-cdda2a366503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c41fa320ae436bb2a62812000640e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:29Z,use_quota=True,user_id='c7c5aeeec84d4769ba9428abe35da39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f289f5f-b3ca-439c-9ce2-e5176ea906d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f289f5f-b3ca-439c-9ce2-e5176ea906d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0544cf26-9553-4823-b595-e0b36bc94b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0544cf26-9553-4823-b595-e0b36bc94b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a55bd7f-4d99-427a-bea2-cdda2a366503', 'volume_name': 'volume-7a55bd7f-4d99-427a-bea2-cdda2a366503', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815d2f38-47d1-408f-9578-282ce21494ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815d2f38-47d1-408f-9578-282ce21494ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e943f8-a7bf-43dc-88d1-1d4c6f9271f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Volume 7a55bd7f-4d99-427a-bea2-cdda2a366503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a55bd7f-4d99-427a-bea2-cdda2a366503', 'volume_size': 1} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1056259843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a55bd7f-4d99-427a-bea2-cdda2a366503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c41fa320ae436bb2a62812000640e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:29Z,use_quota=True,user_id='c7c5aeeec84d4769ba9428abe35da39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Creating volume 7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:29 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:29 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 1073741824 Jul 07 22:36:29 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ed3a2c62-0af0-4543-904d-125fab5c96c1 tempest-GroupSnapshotsV319Test-344521841 None] Group tempest-GroupSnapshotsV319Test-Group-1331205327: creating Jul 07 22:36:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ed3a2c62-0af0-4543-904d-125fab5c96c1 tempest-GroupSnapshotsV319Test-344521841 None] Group tempest-GroupSnapshotsV319Test-Group-1331205327: created successfully Jul 07 22:36:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ed3a2c62-0af0-4543-904d-125fab5c96c1 tempest-GroupSnapshotsV319Test-344521841 None] Create group completed successfully. Jul 07 22:36:30 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 1073741824" returned: 0 in 1.625s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:30 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 Jul 07 22:36:30 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:31 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] <== create_volume: return (2575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.580s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e943f8-a7bf-43dc-88d1-1d4c6f9271f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a55bd7f-4d99-427a-bea2-cdda2a366503', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832c61ee-1e01-4917-81a2-8f7cddd88c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:31 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Volume volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 (7a55bd7f-4d99-427a-bea2-cdda2a366503): created successfully Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832c61ee-1e01-4917-81a2-8f7cddd88c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Flow 'volume_create_manager' (02109c97-1a87-4dcc-81b8-691791fd1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-5ab63116-af25-4f3a-9eb8-b83c9749220a req-8ab0d7f5-12e5-44b0-a5e4-2e3b6f1c74fa tempest-VolumesSnapshotsTestJSON-451009175 None] Created volume successfully. Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Flow 'volume_create_manager' (baa1fdbd-d4ac-4174-8299-59815a06dc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5888b921-0412-4d59-acec-e46a779f706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5888b921-0412-4d59-acec-e46a779f706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104923864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3187a324-7bdc-4549-8ee7-17c02f11f3de,host='devstack@QuobyteHD#QuobyteHD',id=7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c72f46ca947eb8c6809bedebc0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:32Z,use_quota=True,user_id='5c01193bc70c4a91a9a4e9352981708a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49799471-d12f-4020-b4de-7a0f9d86a24f),volume_type_id=49799471-d12f-4020-b4de-7a0f9d86a24f)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1925a817-62db-4706-970a-e25c622e358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1925a817-62db-4706-970a-e25c622e358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c675b4-4824-48f3-8efd-e046236d9ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c675b4-4824-48f3-8efd-e046236d9ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0', 'volume_name': 'volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e81c25d-d084-4952-b5f3-5677cbd4f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e81c25d-d084-4952-b5f3-5677cbd4f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8088c0b9-7823-45bf-af3a-f530eca83210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Volume 7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0', 'volume_size': 1} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3187a324-7bdc-4549-8ee7-17c02f11f3de,created_at=2026-07-07T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104923864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3187a324-7bdc-4549-8ee7-17c02f11f3de,host='devstack@QuobyteHD#QuobyteHD',id=7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c72f46ca947eb8c6809bedebc0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:32Z,use_quota=True,user_id='5c01193bc70c4a91a9a4e9352981708a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49799471-d12f-4020-b4de-7a0f9d86a24f),volume_type_id=49799471-d12f-4020-b4de-7a0f9d86a24f)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Creating volume 7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:32 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:32 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 1073741824 Jul 07 22:36:32 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:33 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 1073741824" returned: 0 in 0.952s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:33 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 Jul 07 22:36:33 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:33 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.192s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Creating offline snapshot 8c5a4bdb-0d79-4bc3-804e-30236d801831 of volume 7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8088c0b9-7823-45bf-af3a-f530eca83210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acc9d43-a4e3-4be5-af99-3f8d8cd80aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618ffa5-8db4-41e5-a19f-f48579d69da3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:33 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Volume volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 (7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0): created successfully Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acc9d43-a4e3-4be5-af99-3f8d8cd80aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Flow 'volume_create_manager' (baa1fdbd-d4ac-4174-8299-59815a06dc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-db70d8b9-482a-4d58-81b3-ceaa02d6c29b tempest-GroupSnapshotsV319Test-344521841 None] Created volume successfully. Jul 07 22:36:34 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 Jul 07 22:36:34 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:34 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] GroupSnapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: creating. Jul 07 22:36:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503" returned: 0 in 0.934s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:34 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 1G Jul 07 22:36:34 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Group snapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: creating. {{(pid=88087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:36:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:35 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 1G" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:35 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 Jul 07 22:36:35 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:36 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:36 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 is being set with open permissions: ugo+rw Jul 07 22:36:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:36 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 Jul 07 22:36:36 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:37 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:37 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info Jul 07 22:36:37 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:38 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info" returned: 0 in 0.769s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:38 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info is being set with open permissions: ugo+rw Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:38 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info Jul 07 22:36:38 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:38 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.info" returned: 0 in 0.810s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.091s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.067s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Creating offline snapshot ada3e9b7-b2ac-4698-94a9-f541bea2de86 of volume 7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8965a1-00eb-44bb-8f7e-f153b6d1c35d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-f4d58d18-db36-4187-a293-3b71378a2f79 req-a139e69e-c469-46c6-8312-95737ff152ff tempest-VolumesSnapshotsTestJSON-451009175 None] Create snapshot completed successfully Jul 07 22:36:39 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 Jul 07 22:36:39 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "cinder-8c5a4bdb-0d79-4bc3-804e-30236d801831-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-8c5a4bdb-0d79-4bc3-804e-30236d801831-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "cinder-quobyte-8c5a4bdb-0d79-4bc3-804e-30236d801831" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:39 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-8c5a4bdb-0d79-4bc3-804e-30236d801831" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Deleting offline snapshot 8c5a4bdb-0d79-4bc3-804e-30236d801831 of volume 7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:36:39 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 1G Jul 07 22:36:39 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] snapshot_file for this snap is: volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[81457819-fc2a-47b6-aaee-5ba91c4c9c3e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:40 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 Jul 07 22:36:40 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:40 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831" returned: 0 in 0.941s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a55bd7f-4d99-427a-bea2-cdda2a366503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:36:40 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 1G" returned: 0 in 1.049s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7cc416-1fc9-4f1f-8187-92d04e1c40a6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:40 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 Jul 07 22:36:40 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:41 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 Jul 07 22:36:41 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:41 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86" returned: 0 in 0.847s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:41 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:36:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:41 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 Jul 07 22:36:41 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:41 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503" returned: 0 in 0.895s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:41 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 Jul 07 22:36:41 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:42 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86" returned: 0 in 0.746s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:42 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info Jul 07 22:36:42 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:42 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:42 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831 Jul 07 22:36:42 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:43 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info" returned: 0 in 0.753s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:43 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:43 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info Jul 07 22:36:43 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:43 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503.8c5a4bdb-0d79-4bc3-804e-30236d801831" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-8c5a4bdb-0d79-4bc3-804e-30236d801831" released by "_delete_snapshot" :: held 3.622s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" released by "delete_snapshot" :: held 3.666s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:43 devstack cinder-volume[88087]: WARNING cinder.quota [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG cinder.quota [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Created reservations ['c35e841c-7c21-475f-8d30-9a4ef2abb3b9', 'abb04168-6cdd-47cb-b8d6-b0886e67fad0', '52b1811a-5b94-4e62-9d72-42b65605efab', '848a2614-348d-4891-bf75-237596dcddac'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Delete snapshot completed successfully. Jul 07 22:36:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-cf849854-0f3e-4df0-bd1e-59fe8c0ab292 req-550cd907-969f-4351-81b5-3674af020c4d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-8c5a4bdb-0d79-4bc3-804e-30236d801831-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:44 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.info" returned: 0 in 0.798s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.173s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "cinder-7a55bd7f-4d99-427a-bea2-cdda2a366503-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-7a55bd7f-4d99-427a-bea2-cdda2a366503-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-af5cdd1a-7a66-4cb0-9a80-dd192fa22cc7 tempest-GroupSnapshotsV319Test-344521841 None] group_snapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: created successfully Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" acquired by "delete_volume" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d40214-e8ed-4beb-a3cb-2da3dd616b16]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:44 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 Jul 07 22:36:44 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] group_snapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: deleting Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] group_snapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: deleting {{(pid=88087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:36:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "cinder-quobyte-ada3e9b7-b2ac-4698-94a9-f541bea2de86" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-ada3e9b7-b2ac-4698-94a9-f541bea2de86" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Deleting offline snapshot ada3e9b7-b2ac-4698-94a9-f541bea2de86 of volume 7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] snapshot_file for this snap is: volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e54a96e-0d6f-409b-8f02-00b3969a6458]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:45 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 Jul 07 22:36:45 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:45 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503" returned: 0 in 1.155s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:45 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503 Jul 07 22:36:45 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:46 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7a55bd7f-4d99-427a-bea2-cdda2a366503" returned: 0 in 0.703s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-quobyte-7a55bd7f-4d99-427a-bea2-cdda2a366503" released by "delete_volume" :: held 1.978s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:46 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86" returned: 0 in 1.256s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c46f7fc-b95a-4046-a173-0e8e128bd4b8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG cinder.quota [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Created reservations ['92e3450f-9fd5-480a-b3b3-2ff0f6240c73', 'c6d27cad-e5ff-4133-8fd7-179bc06a9ea3', '699ff738-c0d3-4539-a4cc-dca8941ca609', '41e0b4cd-9480-4034-8eeb-4dde5e6ebdc7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:46 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 Jul 07 22:36:46 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:46 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:46 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:47 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" returned: 0 in 1.246s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:47 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 Jul 07 22:36:47 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:47 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.231s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:47 devstack cinder-volume[88087]: DEBUG cinder.manager [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Deleted volume successfully. Jul 07 22:36:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-5abb57b9-35b3-42cf-b46f-6563ed4a0406 req-4a7470e8-8f68-49b8-9616-98683412ba8d tempest-VolumesSnapshotsTestJSON-451009175 None] Lock "cinder-7a55bd7f-4d99-427a-bea2-cdda2a366503-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:48 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86" returned: 0 in 0.940s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:48 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86 Jul 07 22:36:48 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:49 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0.ada3e9b7-b2ac-4698-94a9-f541bea2de86" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-ada3e9b7-b2ac-4698-94a9-f541bea2de86" released by "_delete_snapshot" :: held 4.426s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" released by "delete_snapshot" :: held 4.464s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:49 devstack cinder-volume[88087]: WARNING cinder.quota [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1890090296 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1890090296, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:36:49 devstack cinder-volume[88087]: WARNING cinder.quota [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1890090296 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1890090296, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:36:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] Created reservations ['f7c7d69e-dc52-487f-9f94-575e9a1f70bd', '0383e09e-caa7-4755-82f7-5f58993c0b63', '2f2ce221-a407-4e20-a359-275c525adc5b', '1de2089e-559a-4fa3-9632-73e19b5b1b85'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1cad2c34-12af-443c-8b78-a78e6ec845b0 tempest-GroupSnapshotsV319Test-344521841 None] group_snapshot cd4fb052-2e87-4d60-b3c4-49b952b9accb: deleted successfully Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd99ebf-f8f7-48d0-adf5-72690059e317]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Flow 'volume_create_manager' (1874b097-2c76-4f28-9a31-8e99b01b4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dc25db-2c1d-4427-ac85-e9b998c94b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 Jul 07 22:36:51 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dc25db-2c1d-4427-ac85-e9b998c94b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-540407605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9e46c6-8710-4094-8cc2-9c15d9e10bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732b6bc6e0a4786bbaf6a620a953fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:51Z,use_quota=True,user_id='11c2f491c662402da6d43d4112e1cf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f27cbb4-4509-4ebd-b3dc-d229a1528a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f27cbb4-4509-4ebd-b3dc-d229a1528a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0faa8dd-fdb2-42c3-a78e-3027acfe68de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0faa8dd-fdb2-42c3-a78e-3027acfe68de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9e46c6-8710-4094-8cc2-9c15d9e10bee', 'volume_name': 'volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81848ef-404a-44c1-9890-3778957e4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81848ef-404a-44c1-9890-3778957e4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addbc7e0-6d2c-44fe-ad97-52e896b2f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Volume 9e9e46c6-8710-4094-8cc2-9c15d9e10bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee', 'volume_size': 1} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-540407605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9e46c6-8710-4094-8cc2-9c15d9e10bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732b6bc6e0a4786bbaf6a620a953fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:51Z,use_quota=True,user_id='11c2f491c662402da6d43d4112e1cf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Creating volume 9e9e46c6-8710-4094-8cc2-9c15d9e10bee {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:51 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:36:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:51 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee 1073741824 Jul 07 22:36:51 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:52 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" returned: 0 in 1.414s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:52 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0 Jul 07 22:36:52 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:52 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee 1073741824" returned: 0 in 1.290s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:52 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee Jul 07 22:36:52 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:53 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Lock "cinder-quobyte-7d9499f1-fe7b-4a0f-8020-e9f7f2a0cbe0" released by "delete_volume" :: held 2.298s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Created reservations ['7f6de5dd-a7ef-4f56-a6e4-097eb288f5f1'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:53 devstack cinder-volume[88087]: WARNING cinder.quota [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1890090296 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1890090296, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Created reservations ['a41889ef-e130-41ab-9e33-75beb788485c', '0f3884f7-29ea-4567-a5d5-59cbd92d82e9', '4988e693-391b-4363-9bdc-964b541f5b72', 'a470e6c7-3239-4539-a62c-1ceb3bebb1ee'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3d398ab1-3ca2-4cc7-86ed-54a6432eb793 tempest-BackendsCapabilitiesAdminTestsJSON-449333845 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:36:53 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" returned: 0 in 0.862s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addbc7e0-6d2c-44fe-ad97-52e896b2f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7607e0-526e-4f01-9703-2843e99f43c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:53 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Volume volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee (9e9e46c6-8710-4094-8cc2-9c15d9e10bee): created successfully Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7607e0-526e-4f01-9703-2843e99f43c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:53 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:36:53 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Flow 'volume_create_manager' (1874b097-2c76-4f28-9a31-8e99b01b4c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0c5ab0ea-40ee-413f-9f99-59b4c85b9012 tempest-AttachVolumeShelveTestJSON-1563544700 None] Created volume successfully. Jul 07 22:36:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-96ff359d-6e7a-4721-978a-5b752f8ae376 tempest-BackendsCapabilitiesAdminTestsJSON-449333845 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:36:54 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.675s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:54 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1ffe2747-b745-408c-87b7-04752b09ea79 tempest-GroupSnapshotsV319Test-344521841 None] Delete group completed successfully. Jul 07 22:37:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bba52ff2-effe-4a61-9f85-7a726176d227 tempest-GroupsV314Test-16689566 None] Group tempest-GroupsV314Test-Group-952928589: creating Jul 07 22:37:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bba52ff2-effe-4a61-9f85-7a726176d227 tempest-GroupsV314Test-16689566 None] Group tempest-GroupsV314Test-Group-952928589: created successfully Jul 07 22:37:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bba52ff2-effe-4a61-9f85-7a726176d227 tempest-GroupsV314Test-16689566 None] Create group completed successfully. Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Flow 'volume_create_manager' (51175fd4-7160-4c9d-9601-c530054b4e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4e5cb7-a244-421b-9d12-96d32adb2756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4e5cb7-a244-421b-9d12-96d32adb2756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1638020967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48615fbf-8087-4050-a440-004834985075,host='devstack@QuobyteHD#QuobyteHD',id=93b25a15-4bed-4aaf-8c32-15997f68410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9015fe241b410a9a609935f57af8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:05Z,use_quota=True,user_id='c1dd08eaedc64ca5a8dd91eab8b8fde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb7c6d3-1db7-4852-93cb-41116fd4689f),volume_type_id=9bb7c6d3-1db7-4852-93cb-41116fd4689f)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbaa49f-e9d3-4009-b766-b94f7a31515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbaa49f-e9d3-4009-b766-b94f7a31515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71de550e-0f2e-4443-9184-bd80c78fe3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71de550e-0f2e-4443-9184-bd80c78fe3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b25a15-4bed-4aaf-8c32-15997f68410b', 'volume_name': 'volume-93b25a15-4bed-4aaf-8c32-15997f68410b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b813878e-6f82-46ae-9aef-1d007e591211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b813878e-6f82-46ae-9aef-1d007e591211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddd307e-9862-4cb6-a123-5bfaacec4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:05 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Volume 93b25a15-4bed-4aaf-8c32-15997f68410b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b25a15-4bed-4aaf-8c32-15997f68410b', 'volume_size': 1} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48615fbf-8087-4050-a440-004834985075,created_at=2026-07-07T20:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1638020967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48615fbf-8087-4050-a440-004834985075,host='devstack@QuobyteHD#QuobyteHD',id=93b25a15-4bed-4aaf-8c32-15997f68410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9015fe241b410a9a609935f57af8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:05Z,use_quota=True,user_id='c1dd08eaedc64ca5a8dd91eab8b8fde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb7c6d3-1db7-4852-93cb-41116fd4689f),volume_type_id=9bb7c6d3-1db7-4852-93cb-41116fd4689f)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Creating volume 93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:05 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:37:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:05 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b 1073741824 Jul 07 22:37:05 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:06 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b 1073741824" returned: 0 in 1.156s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:06 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:06 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:07 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 0.811s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddd307e-9862-4cb6-a123-5bfaacec4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b25a15-4bed-4aaf-8c32-15997f68410b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9da1e-c09f-4a76-a817-8bcfbdd2810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:07 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Volume volume-93b25a15-4bed-4aaf-8c32-15997f68410b (93b25a15-4bed-4aaf-8c32-15997f68410b): created successfully Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9da1e-c09f-4a76-a817-8bcfbdd2810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Flow 'volume_create_manager' (51175fd4-7160-4c9d-9601-c530054b4e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-52a878fb-4209-4c37-aa6f-be0e4347f67f tempest-GroupsV314Test-16689566 None] Created volume successfully. Jul 07 22:37:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:10 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Cloning volume 93b25a15-4bed-4aaf-8c32-15997f68410b to volume 6a2ee5c2-ef37-4306-83fc-b60990803017 Jul 07 22:37:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Creating offline snapshot eca4fcc3-187e-440e-966e-96596e57f631 of volume 93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:37:10 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c2660-c3f6-413c-a192-d97ba45a1508]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:10 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:10 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:11 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.157s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:11 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 1G Jul 07 22:37:11 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:12 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 1G" returned: 0 in 1.166s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b25a15-4bed-4aaf-8c32-15997f68410b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:12 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b25a15-4bed-4aaf-8c32-15997f68410b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:12 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:14 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b25a15-4bed-4aaf-8c32-15997f68410b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 1.345s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:14 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:37:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:14 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:14 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:15 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 1.065s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:15 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info Jul 07 22:37:15 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:15 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:37:15 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-9df12f09-43fb-4a9a-8bd6-0a8c89059859 req-04d67d39-6f80-4577-b5b0-ae8f2e399d07 tempest-AttachVolumeShelveTestJSON-1563544700 None] No connector for attachment 5bab1bf8-dc72-4847-bc64-496d0e736d94; skipping storage backend terminate_connection call. {{(pid=88087) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 22:37:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-9df12f09-43fb-4a9a-8bd6-0a8c89059859 req-04d67d39-6f80-4577-b5b0-ae8f2e399d07 tempest-AttachVolumeShelveTestJSON-1563544700 None] Deleting attachment 5bab1bf8-dc72-4847-bc64-496d0e736d94. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:37:16 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info" returned: 0 in 1.034s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:16 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:37:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:16 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info Jul 07 22:37:16 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:16 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.181s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.info" returned: 0 in 1.402s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:17 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Acquiring lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] snapshot: eca4fcc3-187e-440e-966e-96596e57f631, volume: 6a2ee5c2-ef37-4306-83fc-b60990803017, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d858328-726f-4760-ab3d-50f2a1bd9dfa]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:18 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:18 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:19 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 1.324s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b25a15-4bed-4aaf-8c32-15997f68410b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cec001e-df33-4abb-9adf-b7aba23d878f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:19 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:19 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:20 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.352s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:20 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:37:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:20 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 Jul 07 22:37:20 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:25 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=65,cinder:INSERT=14,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:37:25 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=55,cinder:UPDATE=60,cinder:DELETE=2,cinder:INSERT=18 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:37:28 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017" returned: 0 in 8.219s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7d16f-b7f0-48fd-89b3-67834341e4b8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:29 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:29 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:30 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.298s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:30 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:37:30 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Converted 1024.00 MB image at 124.55 MB/s Jul 07 22:37:30 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:37:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:30 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 Jul 07 22:37:30 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:31 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" released by "_copy_volume_from_snapshot" :: held 13.166s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Acquiring lock "cinder-quobyte-eca4fcc3-187e-440e-966e-96596e57f631" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-eca4fcc3-187e-440e-966e-96596e57f631" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Deleting offline snapshot eca4fcc3-187e-440e-966e-96596e57f631 of volume 93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] snapshot_file for this snap is: volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c325a14-877c-4898-a001-f5c1e3f9ed6c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:31 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:31 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:32 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 1.197s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b25a15-4bed-4aaf-8c32-15997f68410b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:37:32 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d9b40-b5b5-43e0-ba42-f14d72b9da1e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:32 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:32 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:33 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.027s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:33 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:33 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:34 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 1.113s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:34 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631 Jul 07 22:37:34 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:35 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b.eca4fcc3-187e-440e-966e-96596e57f631" returned: 0 in 0.899s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-eca4fcc3-187e-440e-966e-96596e57f631" released by "_delete_snapshot" :: held 4.404s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.123s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8b880e5b-57d5-46c1-a68a-6b44b664356b tempest-GroupsV314Test-16689566 None] Create group from source-group-48615fbf-8087-4050-a440-004834985075 completed successfully. Jul 07 22:37:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Acquiring lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3045b7a9-11e8-43e5-b417-bbb047da2aca]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:37 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 Jul 07 22:37:37 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:37 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017" returned: 0 in 1.010s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:37 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017 Jul 07 22:37:37 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:38 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6a2ee5c2-ef37-4306-83fc-b60990803017" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-6a2ee5c2-ef37-4306-83fc-b60990803017" released by "delete_volume" :: held 1.853s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:38 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Created reservations ['4a5f508a-0f58-411d-af73-1f29d36cc94e'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:39 devstack cinder-volume[88087]: WARNING cinder.quota [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1631929126 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1631929126, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:37:39 devstack cinder-volume[88087]: WARNING cinder.quota [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1631929126 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1631929126, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Created reservations ['521e9a43-f7bd-4dc8-84aa-ea3987dd384a', '2ea477ca-c029-4ac8-b56d-35f81f6377fe', 'd2e22a1d-e3b2-45d9-b607-d070eab5dc56', '7bd44310-54e2-4173-a1d5-8de68e35a0fc'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:39 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:37:39 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Acquiring lock "cinder-quobyte-93b25a15-4bed-4aaf-8c32-15997f68410b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-93b25a15-4bed-4aaf-8c32-15997f68410b" acquired by "delete_volume" :: waited 0.038s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39ba2e-df8b-4822-bdd3-9beac1e832e3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:40 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:40 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:40 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.276s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:40 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2474e009-160b-40a1-b69d-0c2e1ce95b32 tempest-GroupsV314Test-16689566 None] Delete group completed successfully. Jul 07 22:37:41 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.084s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:41 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b Jul 07 22:37:41 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:42 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-93b25a15-4bed-4aaf-8c32-15997f68410b" returned: 0 in 1.343s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Lock "cinder-quobyte-93b25a15-4bed-4aaf-8c32-15997f68410b" released by "delete_volume" :: held 2.548s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:42 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Created reservations ['3c302755-a57b-49af-8742-5d68c89af863'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:42 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Created reservations ['559e3b81-8ca2-479d-ba18-acecabdc605d', 'd7fd6e63-439e-480a-b88d-4683c641e49f', 'c2c4a150-d460-4b4d-b1b3-e818fed882bc', 'a36d211f-6ccb-4581-8941-201919f151cb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:43 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:37:43 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:44 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.005s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1e07b4ea-0a8a-4c54-9a55-cab354b1b28f tempest-GroupsV314Test-16689566 None] Delete group completed successfully. Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (63174df9-4960-44a5-ad73-5adecebc4d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f304261b-73bc-4074-ac85-3942dbdb9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f304261b-73bc-4074-ac85-3942dbdb9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1838810682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6156b8a-2f74-4367-a8f8-79d18e080194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:44Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3ebb5b-a0be-432f-b573-b6f0e797e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3ebb5b-a0be-432f-b573-b6f0e797e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401b936b-e3ab-4e99-87a1-b447aefaf15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401b936b-e3ab-4e99-87a1-b447aefaf15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6156b8a-2f74-4367-a8f8-79d18e080194', 'volume_name': 'volume-d6156b8a-2f74-4367-a8f8-79d18e080194', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe4887e-825b-482b-8984-a9894b97882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe4887e-825b-482b-8984-a9894b97882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f61aa6a-7256-438f-b83c-15fc39e3ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Volume d6156b8a-2f74-4367-a8f8-79d18e080194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6156b8a-2f74-4367-a8f8-79d18e080194', 'volume_size': 1} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1838810682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6156b8a-2f74-4367-a8f8-79d18e080194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:44Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Creating volume d6156b8a-2f74-4367-a8f8-79d18e080194 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:44 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:37:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:44 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 1073741824 Jul 07 22:37:44 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Flow 'volume_create_manager' (79771957-3049-494d-8452-2dfb2b41c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa54448-eade-486c-8766-18a6e7793715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:45 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 1073741824" returned: 0 in 1.175s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa54448-eade-486c-8766-18a6e7793715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1175850141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6499a3-7298-4ff9-abb4-bd65f236aaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ac10e7f8240b7b2984703ad60f5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:45Z,use_quota=True,user_id='fab0f618f739437faeb5a23e16ff2813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15555d2-459f-42b0-9cb5-6c714a62f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15555d2-459f-42b0-9cb5-6c714a62f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd51992-a915-415c-bb9d-7b92a1af9681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd51992-a915-415c-bb9d-7b92a1af9681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6499a3-7298-4ff9-abb4-bd65f236aaad', 'volume_name': 'volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceba5871-c14d-4f44-b9a4-9810de6d8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceba5871-c14d-4f44-b9a4-9810de6d8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0eaf87-481f-4293-96f5-2c1582c3aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Volume bc6499a3-7298-4ff9-abb4-bd65f236aaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad', 'volume_size': 1} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:45 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 Jul 07 22:37:45 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:46 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194" returned: 0 in 0.724s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1175850141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6499a3-7298-4ff9-abb4-bd65f236aaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ac10e7f8240b7b2984703ad60f5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:45Z,use_quota=True,user_id='fab0f618f739437faeb5a23e16ff2813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Creating volume bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:46 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f61aa6a-7256-438f-b83c-15fc39e3ed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6156b8a-2f74-4367-a8f8-79d18e080194', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5376ac10-959a-4f54-90c4-95d9475ffdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad 1073741824 Jul 07 22:37:46 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:46 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Volume volume-d6156b8a-2f74-4367-a8f8-79d18e080194 (d6156b8a-2f74-4367-a8f8-79d18e080194): created successfully Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5376ac10-959a-4f54-90c4-95d9475ffdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (63174df9-4960-44a5-ad73-5adecebc4d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e428fa58-96d9-48a8-9f6f-e99742c7fc5f tempest-AttachVolumeNegativeTest-1968883960 None] Created volume successfully. Jul 07 22:37:47 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad 1073741824" returned: 0 in 0.962s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:47 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad Jul 07 22:37:47 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:48 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad" returned: 0 in 0.810s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0eaf87-481f-4293-96f5-2c1582c3aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8444a9b-b40e-445d-bc96-dce9e2a853fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:48 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Volume volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad (bc6499a3-7298-4ff9-abb4-bd65f236aaad): created successfully Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8444a9b-b40e-445d-bc96-dce9e2a853fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Flow 'volume_create_manager' (79771957-3049-494d-8452-2dfb2b41c551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-aef442da-6c83-4b7b-b3aa-97dbddc2bef1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Created volume successfully. Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Creating offline snapshot f28d4fcf-74f5-4164-8253-2f656434eb12 of volume bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47391a4-c42f-4469-825d-7f1a020d0481]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:49 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad Jul 07 22:37:49 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:49 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad" returned: 0 in 0.916s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:49 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 1G Jul 07 22:37:49 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:51 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 1G" returned: 0 in 1.275s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:51 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 Jul 07 22:37:51 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:51 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12" returned: 0 in 0.741s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:51 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 is being set with open permissions: ugo+rw Jul 07 22:37:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:51 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 Jul 07 22:37:51 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:52 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12" returned: 0 in 0.758s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:52 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info Jul 07 22:37:52 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:53 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:53 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info is being set with open permissions: ugo+rw Jul 07 22:37:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:53 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info Jul 07 22:37:53 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:54 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.info" returned: 0 in 0.678s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.301s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2847122-2bc3-4387-a56b-a40f20feb3d8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-621dcee8-39b9-49c0-abda-4330c7e88b69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Create snapshot completed successfully Jul 07 22:37:54 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 Jul 07 22:37:54 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:55 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194" returned: 0 in 1.040s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-d6156b8a-2f74-4367-a8f8-79d18e080194', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29ba1f85-fe8c-4123-9ede-4f37cd227ac1', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "cinder-f28d4fcf-74f5-4164-8253-2f656434eb12-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-f28d4fcf-74f5-4164-8253-2f656434eb12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "cinder-quobyte-f28d4fcf-74f5-4164-8253-2f656434eb12" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-f28d4fcf-74f5-4164-8253-2f656434eb12" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Deleting offline snapshot f28d4fcf-74f5-4164-8253-2f656434eb12 of volume bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] snapshot_file for this snap is: volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:37:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-1b2a17e9-6ebf-48f3-9213-fc4bc10fa7f2 req-d9b3891c-2f36-448d-b0af-18471a43537e tempest-AttachVolumeNegativeTest-1968883960 None] attachment_update completed successfully. Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[171dae65-b8cd-402a-8ca4-8d7bfb5e01d8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:55 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 Jul 07 22:37:55 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:56 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12" returned: 0 in 0.908s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:37:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7c268-1227-448f-a69e-f21e40046a6c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:56 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad Jul 07 22:37:56 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:57 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad" returned: 0 in 0.822s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:57 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 Jul 07 22:37:57 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:58 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12" returned: 0 in 0.902s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:58 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12 Jul 07 22:37:58 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:58 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad.f28d4fcf-74f5-4164-8253-2f656434eb12" returned: 0 in 0.670s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-f28d4fcf-74f5-4164-8253-2f656434eb12" released by "_delete_snapshot" :: held 3.429s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" released by "delete_snapshot" :: held 3.458s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Created reservations ['f613ac5b-c287-42a6-a40d-40dae87b6a0a', '2ae99000-93d8-435a-8739-322419385edb', '273de862-7908-473c-9b4a-a30a183e356e', '50dfa7a1-1b5f-4146-8939-0acc511664ae'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Delete snapshot completed successfully. Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-83f4e48c-85c9-4b59-995d-63f5a40118dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-f28d4fcf-74f5-4164-8253-2f656434eb12-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "cinder-bc6499a3-7298-4ff9-abb4-bd65f236aaad-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-bc6499a3-7298-4ff9-abb4-bd65f236aaad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[13629b9d-1041-4a01-813c-88e5c600f278]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:00 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad Jul 07 22:38:00 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:01 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad" returned: 0 in 1.134s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:01 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad Jul 07 22:38:01 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:01 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bc6499a3-7298-4ff9-abb4-bd65f236aaad" returned: 0 in 0.793s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-quobyte-bc6499a3-7298-4ff9-abb4-bd65f236aaad" released by "delete_volume" :: held 2.031s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Created reservations ['13f83390-54a8-463e-b360-8c200916f5f8', '620a0f80-6f5c-4c04-ab95-caa5f1f997ac', '2e75c63e-c822-4298-8eda-a16f010cafc7', '68a524c5-f1be-4af2-a813-0186ffed69ee'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:02 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:02 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:03 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.044s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:03 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Deleted volume successfully. Jul 07 22:38:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fc876ee1-4aba-476d-9bcc-ec8366cbb475 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564532851 None] Lock "cinder-bc6499a3-7298-4ff9-abb4-bd65f236aaad-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Flow 'volume_create_manager' (43eb1da0-31cf-470e-9965-138cf5bf1833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93a1046-882a-4c24-bbad-a7e34f03c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93a1046-882a-4c24-bbad-a7e34f03c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-892153276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9cacfe-a49c-4de5-99b3-501d7215dc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2d0b62fdd94bc2b96ea0121735c7a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:09Z,use_quota=True,user_id='6bfa88a737f94cf6ba9fe207114d3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25539c7-4ca1-4ddf-baab-c0fc7b5a071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25539c7-4ca1-4ddf-baab-c0fc7b5a071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0036a4-8d6f-4371-82dd-6721a650d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0036a4-8d6f-4371-82dd-6721a650d340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9cacfe-a49c-4de5-99b3-501d7215dc1d', 'volume_name': 'volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342104f-b5dc-4300-8b77-cbe3197826ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342104f-b5dc-4300-8b77-cbe3197826ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1bdd9a-fd56-4fd6-9092-d4b781e2d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Volume 2a9cacfe-a49c-4de5-99b3-501d7215dc1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d', 'volume_size': 1} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-892153276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9cacfe-a49c-4de5-99b3-501d7215dc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2d0b62fdd94bc2b96ea0121735c7a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:09Z,use_quota=True,user_id='6bfa88a737f94cf6ba9fe207114d3571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Creating volume 2a9cacfe-a49c-4de5-99b3-501d7215dc1d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:09 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:09 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d 1073741824 Jul 07 22:38:09 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:10 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d 1073741824" returned: 0 in 1.180s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:10 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d Jul 07 22:38:10 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:11 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1bdd9a-fd56-4fd6-9092-d4b781e2d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8a630f-cc16-467b-86cb-473fb7f5eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:11 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Volume volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d (2a9cacfe-a49c-4de5-99b3-501d7215dc1d): created successfully Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8a630f-cc16-467b-86cb-473fb7f5eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Flow 'volume_create_manager' (43eb1da0-31cf-470e-9965-138cf5bf1833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f7cc7a2a-0f28-4483-bece-67658c27e6de tempest-VolumeQuotasNegativeTestJSON-730224033 None] Created volume successfully. Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Acquiring lock "cinder-2a9cacfe-a49c-4de5-99b3-501d7215dc1d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "cinder-2a9cacfe-a49c-4de5-99b3-501d7215dc1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Acquiring lock "cinder-quobyte-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "cinder-quobyte-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb230f-8b7f-479d-bf75-2bb4f52f7eee]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:13 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d Jul 07 22:38:13 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Acquiring lock "cinder-9e9e46c6-8710-4094-8cc2-9c15d9e10bee-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "cinder-9e9e46c6-8710-4094-8cc2-9c15d9e10bee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Acquiring lock "cinder-quobyte-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "cinder-quobyte-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2bc4f7-a941-4684-9dc1-74704c307224]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:14 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee Jul 07 22:38:14 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:14 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" returned: 0 in 0.994s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:14 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d Jul 07 22:38:14 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:15 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" returned: 0 in 0.867s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:15 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee Jul 07 22:38:15 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:15 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" returned: 0 in 0.746s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "cinder-quobyte-2a9cacfe-a49c-4de5-99b3-501d7215dc1d" released by "delete_volume" :: held 1.805s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:15 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:15 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Created reservations ['3a267533-6678-4765-9ca9-b5d1460a23d5', '4feeb02e-161d-4218-a007-a151b7960531', '89844556-fb1f-44ab-9598-ff06f35f783c', '54e472fc-3c8c-4fe9-a3e2-1b5b8911585f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:15 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" returned: 0 in 0.716s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:15 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:15 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "cinder-quobyte-9e9e46c6-8710-4094-8cc2-9c15d9e10bee" released by "delete_volume" :: held 1.655s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:15 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Created reservations ['764d5a1d-9121-4a56-9332-bb38b946b93c', '773d729b-f92c-44ea-bd27-7317ab933015', '4704c5c9-73b3-4942-918f-748b35cdde15', 'dbff981f-ce03-4691-916b-61cd1ef97ce8'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:16 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:16 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:16 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.366s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 8 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:38:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:38:17 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.397s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Deleted volume successfully. Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5e2dfb5b-16f9-4d3c-9d6e-49b8ef0f9759 tempest-VolumeQuotasNegativeTestJSON-730224033 None] Lock "cinder-2a9cacfe-a49c-4de5-99b3-501d7215dc1d-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:17 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.243s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Deleted volume successfully. Jul 07 22:38:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e800dc0-8b6c-43b5-80e0-5953b2b337fa tempest-AttachVolumeShelveTestJSON-1563544700 None] Lock "cinder-9e9e46c6-8710-4094-8cc2-9c15d9e10bee-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Flow 'volume_create_manager' (e97a21a4-a106-4045-944a-131ce1f39129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd948b-9511-4dc7-ab35-22dbd02bc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd948b-9511-4dc7-ab35-22dbd02bc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843261802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73d881c-06d7-4f93-98c5-1c5fcb648904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082ebfc432f54598bef8fcfe271b03cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:21Z,use_quota=True,user_id='47144d1cac3d49f1962ebb018557d786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54be58b0-a530-4a90-bf0f-5fbb315edae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54be58b0-a530-4a90-bf0f-5fbb315edae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de0fd3f-0ba4-4e87-8a95-a2cc4ef07277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:21 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de0fd3f-0ba4-4e87-8a95-a2cc4ef07277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b73d881c-06d7-4f93-98c5-1c5fcb648904', 'volume_name': 'volume-b73d881c-06d7-4f93-98c5-1c5fcb648904', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f8243-be28-427d-bff7-470ab9cd163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f8243-be28-427d-bff7-470ab9cd163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7689a5aa-a5f0-45c0-b876-124296c64d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:22 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Volume b73d881c-06d7-4f93-98c5-1c5fcb648904: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b73d881c-06d7-4f93-98c5-1c5fcb648904', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Trying to clone b73d881c-06d7-4f93-98c5-1c5fcb648904 from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:38:22 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8da13a-bf2c-4c98-8250-57e5c78c4080]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:23 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD Jul 07 22:38:23 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:24 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD" returned: 0 in 1.452s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:24 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 is fetched for user 47144d1cac3d49f1962ebb018557d786. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:38:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bea2bc-d86e-4749-aad9-e8c854498ac6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:24 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD Jul 07 22:38:24 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:25 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD" returned: 0 in 1.160s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843261802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73d881c-06d7-4f93-98c5-1c5fcb648904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082ebfc432f54598bef8fcfe271b03cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:21Z,use_quota=True,user_id='47144d1cac3d49f1962ebb018557d786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Creating volume b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:25 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:25 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1073741824 Jul 07 22:38:25 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:26 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1073741824" returned: 0 in 1.247s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:26 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=75,cinder:SELECT=55,cinder:INSERT=15,cinder:DELETE=2 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:38:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:27 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:27 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:27 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 0 in 0.924s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Attempting download of bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume b73d881c-06d7-4f93-98c5-1c5fcb648904. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f6411-10e7-481d-ba53-e69dc11982a7]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Flow 'volume_create_manager' (53bee68a-a3c8-4a39-8a62-11e6c08c4b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92d653a-771b-4251-bc5f-82da68758a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92d653a-771b-4251-bc5f-82da68758a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1589149832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f84c507-c7a4-43d2-bebc-5be2f9b79f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f60f9f7e1bd4d408e8574a46df58da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:28Z,use_quota=True,user_id='e722a56f5212428a9a646a4747fbf289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(210901b0-3e4b-43ee-8ea5-7b1ecc5d98bd),volume_type_id=210901b0-3e4b-43ee-8ea5-7b1ecc5d98bd)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e2d5d4-733e-4ad6-ae1d-9bc9f3405523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e2d5d4-733e-4ad6-ae1d-9bc9f3405523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961dc0c5-af72-45da-9f43-42d1ae22e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961dc0c5-af72-45da-9f43-42d1ae22e05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f84c507-c7a4-43d2-bebc-5be2f9b79f99', 'volume_name': 'volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:28 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70 Jul 07 22:38:28 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18dd605-aa57-4faa-9721-b74d0ba38281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18dd605-aa57-4faa-9721-b74d0ba38281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cac2a9-84c6-4613-aaec-1c44e40abea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Volume 6f84c507-c7a4-43d2-bebc-5be2f9b79f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99', 'volume_size': 1} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1589149832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f84c507-c7a4-43d2-bebc-5be2f9b79f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f60f9f7e1bd4d408e8574a46df58da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:28Z,use_quota=True,user_id='e722a56f5212428a9a646a4747fbf289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(210901b0-3e4b-43ee-8ea5-7b1ecc5d98bd),volume_type_id=210901b0-3e4b-43ee-8ea5-7b1ecc5d98bd)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Creating volume 6f84c507-c7a4-43d2-bebc-5be2f9b79f99 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:28 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:28 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 1073741824 Jul 07 22:38:28 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:28 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70" returned: 0 in 0.867s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:29 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70 Jul 07 22:38:29 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:29 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 1073741824" returned: 0 in 1.124s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:29 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 Jul 07 22:38:29 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:29 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70" returned: 1 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_rcgrcf70' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d3045-e68f-4982-a03c-178fc77f6819]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:30 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD Jul 07 22:38:30 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:30 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" returned: 0 in 0.941s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cac2a9-84c6-4613-aaec-1c44e40abea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca58b87-842d-4984-b32d-472b59b21b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:30 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Volume volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 (6f84c507-c7a4-43d2-bebc-5be2f9b79f99): created successfully Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca58b87-842d-4984-b32d-472b59b21b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Flow 'volume_create_manager' (53bee68a-a3c8-4a39-8a62-11e6c08c4b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-265bced2-42a3-46df-b753-1bf3c8106afe tempest-VolumeTypesAccessTest-1196253286 None] Created volume successfully. Jul 07 22:38:30 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD" returned: 0 in 0.928s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 was qcow2, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:38:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:30 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:30 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Acquiring lock "cinder-6f84c507-c7a4-43d2-bebc-5be2f9b79f99-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "cinder-6f84c507-c7a4-43d2-bebc-5be2f9b79f99-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Acquiring lock "cinder-quobyte-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "cinder-quobyte-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe710c04-0be4-41e0-b25c-a08511d28a7e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:31 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 Jul 07 22:38:31 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:32 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" returned: 0 in 1.185s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:32 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99 Jul 07 22:38:32 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:33 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 0 in 2.466s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_n03zbpmkdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:38:33 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Converted 112.00 MB image at 45.39 MB/s Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:33 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1G Jul 07 22:38:33 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:33 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" returned: 0 in 0.736s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "cinder-quobyte-6f84c507-c7a4-43d2-bebc-5be2f9b79f99" released by "delete_volume" :: held 1.978s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:33 devstack cinder-volume[88087]: WARNING cinder.quota [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1242659265 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1242659265, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:38:33 devstack cinder-volume[88087]: WARNING cinder.quota [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1242659265 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1242659265, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Created reservations ['c7a3b9fa-8229-435d-ad8f-33a193f0f9ed', '5023e244-a4a1-45de-acaa-89ff3fff79b1', '06a75393-e758-4598-a928-04e5d3f540b9', 'b94ccc52-8a89-47b2-92da-2c5ddd4d0db7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:33 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:33 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:34 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 1G" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f8925-6198-4ed2-b491-a5d62e0b1dd2]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:34 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:34 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:34 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.702s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Deleted volume successfully. Jul 07 22:38:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-277cac18-75f4-4e34-8050-a32ab8649c74 tempest-VolumeTypesAccessTest-1196253286 None] Lock "cinder-6f84c507-c7a4-43d2-bebc-5be2f9b79f99-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:35 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:35 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:35 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-95871740-57df-4113-94b6-a2e8078815ee tempest-GroupsV320Test-1449445749 None] Group tempest-GroupsV320Test-Group-560844052: creating Jul 07 22:38:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-95871740-57df-4113-94b6-a2e8078815ee tempest-GroupsV320Test-1449445749 None] Group tempest-GroupsV320Test-Group-560844052: created successfully Jul 07 22:38:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-95871740-57df-4113-94b6-a2e8078815ee tempest-GroupsV320Test-1449445749 None] Create group completed successfully. Jul 07 22:38:35 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 1 in 0.904s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Downloaded image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume b73d881c-06d7-4f93-98c5-1c5fcb648904 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 for user 47144d1cac3d49f1962ebb018557d786 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Marking volume b73d881c-06d7-4f93-98c5-1c5fcb648904 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=78,cinder:SELECT=64,cinder:INSERT=20,cinder:DELETE=6 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Copying metadata from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 to b73d881c-06d7-4f93-98c5-1c5fcb648904. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:38:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Creating volume glance metadata for volume b73d881c-06d7-4f93-98c5-1c5fcb648904 backed by image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:38:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7689a5aa-a5f0-45c0-b876-124296c64d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73d881c-06d7-4f93-98c5-1c5fcb648904', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e5fc2-497b-4b89-b49b-39003393cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Volume volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 (b73d881c-06d7-4f93-98c5-1c5fcb648904): created successfully Jul 07 22:38:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e5fc2-497b-4b89-b49b-39003393cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Flow 'volume_create_manager' (e97a21a4-a106-4045-944a-131ce1f39129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4c46673d-f1dd-4faf-a0c0-1aa092209b96 tempest-VolumesImageMetadata-1933895041 None] Created volume successfully. Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Created reservations ['c3b38755-e983-43c7-b1fc-ec61bc0f5f3d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:37 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:37 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Acquiring lock "cinder-b73d881c-06d7-4f93-98c5-1c5fcb648904-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "cinder-b73d881c-06d7-4f93-98c5-1c5fcb648904-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Acquiring lock "cinder-quobyte-b73d881c-06d7-4f93-98c5-1c5fcb648904" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "cinder-quobyte-b73d881c-06d7-4f93-98c5-1c5fcb648904" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f89f1-61b3-4edc-9688-13404a2f3c76]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:37 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:37 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:37 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.740s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:37 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1820b958-ffbe-4955-9339-f538403bf437 tempest-GroupsV320Test-1449445749 None] Delete group completed successfully. Jul 07 22:38:38 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 0 in 0.948s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:38 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:38 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:39 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 1 in 0.997s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:38:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:39 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904 Jul 07 22:38:39 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:40 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b73d881c-06d7-4f93-98c5-1c5fcb648904" returned: 0 in 0.839s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "cinder-quobyte-b73d881c-06d7-4f93-98c5-1c5fcb648904" released by "delete_volume" :: held 2.859s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Created reservations ['2009149d-3aa6-4353-b004-3501da481204', 'e1572c8a-1552-44bc-aee3-228d726d3539', '89be5a54-af01-4221-8dd6-0a19be3e440e', '7f0a51cb-7e0a-450c-be4b-be3b9552e18d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:40 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:40 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:41 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.771s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:41 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Deleted volume successfully. Jul 07 22:38:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fb6a1906-b926-4f03-a9ae-9d73cff0ae09 tempest-VolumesImageMetadata-1933895041 None] Lock "cinder-b73d881c-06d7-4f93-98c5-1c5fcb648904-delete_volume" released by "delete_volume" :: held 3.945s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (498ca607-c07c-4df0-97d9-bd52e73de4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81312c59-5fb9-4b44-a6e7-ade0f5e2ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81312c59-5fb9-4b44-a6e7-ade0f5e2ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1469694879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1eaf37-cafe-4a2f-93e3-81e15f694c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:44Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5bb267-4447-4438-af37-4cc4cf98279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5bb267-4447-4438-af37-4cc4cf98279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c0a98-2ada-430b-9880-e35805a8ee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c0a98-2ada-430b-9880-e35805a8ee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1eaf37-cafe-4a2f-93e3-81e15f694c4b', 'volume_name': 'volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0946848-ae26-4cb6-ab8a-24d8eace6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0946848-ae26-4cb6-ab8a-24d8eace6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022527f-a9a2-4791-885d-f2d12faf2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Volume 1d1eaf37-cafe-4a2f-93e3-81e15f694c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b', 'volume_size': 1} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1469694879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1eaf37-cafe-4a2f-93e3-81e15f694c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:44Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Creating volume 1d1eaf37-cafe-4a2f-93e3-81e15f694c4b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:43 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:43 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b 1073741824 Jul 07 22:38:43 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (bfe9418f-4c58-4d08-81bd-c8b1afed10d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f8bd5e-36c9-4473-9512-2cb1a807d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f8bd5e-36c9-4473-9512-2cb1a807d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-139300325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c16e0fc-4659-46c3-a2c0-2260c80e8635,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:45Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbac0d1-a92f-41e9-8748-f644447b0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbac0d1-a92f-41e9-8748-f644447b0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca4198-fb0d-4ef9-9764-0f39d70595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca4198-fb0d-4ef9-9764-0f39d70595f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c16e0fc-4659-46c3-a2c0-2260c80e8635', 'volume_name': 'volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803d885-9297-4c84-8b84-a0fea86b4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803d885-9297-4c84-8b84-a0fea86b4daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5d1e09-20fa-468e-bbfb-33fc628ea813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Volume 6c16e0fc-4659-46c3-a2c0-2260c80e8635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635', 'volume_size': 1} Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:44 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b 1073741824" returned: 0 in 1.043s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:45 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b Jul 07 22:38:45 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Flow 'volume_create_manager' (3c213e4e-b1c3-4f7f-bd02-dc05202d1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94430067-bbaf-42ef-84e6-7a8938b698fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94430067-bbaf-42ef-84e6-7a8938b698fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-35411796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6c04ae-1a99-4181-a3bc-018570057e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6358db95b54cf0a197542a95ac292c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:45Z,use_quota=True,user_id='8baebff305304bc08b186d07caeb5629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a02291-b082-445d-b8a2-48e4cb08c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a02291-b082-445d-b8a2-48e4cb08c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d3c82-7d94-49ec-8024-9445e8d91293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d3c82-7d94-49ec-8024-9445e8d91293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6c04ae-1a99-4181-a3bc-018570057e6a', 'volume_name': 'volume-9e6c04ae-1a99-4181-a3bc-018570057e6a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d509379-75c8-45d1-8b03-9533e8258930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d509379-75c8-45d1-8b03-9533e8258930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7c7a23-8ed2-4abb-a175-5a0930d011b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Volume 9e6c04ae-1a99-4181-a3bc-018570057e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6c04ae-1a99-4181-a3bc-018570057e6a', 'volume_size': 1} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:45 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" returned: 0 in 0.779s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-139300325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c16e0fc-4659-46c3-a2c0-2260c80e8635,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:45Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Creating volume 6c16e0fc-4659-46c3-a2c0-2260c80e8635 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:45 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:45 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 1073741824 Jul 07 22:38:45 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022527f-a9a2-4791-885d-f2d12faf2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73973b19-0ff6-4b29-b6b9-531774997c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Volume volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b (1d1eaf37-cafe-4a2f-93e3-81e15f694c4b): created successfully Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73973b19-0ff6-4b29-b6b9-531774997c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (498ca607-c07c-4df0-97d9-bd52e73de4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8b789efb-a80f-42ed-a168-c3d805ce5244 tempest-VolumesListAdminTestJSON-1406309401 None] Created volume successfully. Jul 07 22:38:46 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 1073741824" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:46 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 Jul 07 22:38:46 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:47 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635" returned: 0 in 0.899s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.070s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-35411796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6c04ae-1a99-4181-a3bc-018570057e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6358db95b54cf0a197542a95ac292c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:45Z,use_quota=True,user_id='8baebff305304bc08b186d07caeb5629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Creating volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:47 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:47 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a 1073741824 Jul 07 22:38:47 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5d1e09-20fa-468e-bbfb-33fc628ea813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0080d7-93cb-412f-b0e8-2aee0249dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:47 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Volume volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 (6c16e0fc-4659-46c3-a2c0-2260c80e8635): created successfully Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0080d7-93cb-412f-b0e8-2aee0249dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (bfe9418f-4c58-4d08-81bd-c8b1afed10d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-390b83c8-1d44-422d-9b71-7741f89703b7 tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (3c7a676a-d397-48ae-b6c6-3c7a0054a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e46ebaa-bf23-4a3a-8d66-82b2f0f332ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e46ebaa-bf23-4a3a-8d66-82b2f0f332ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659966080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe48e0a-4e90-4a1a-b933-7cab223fa5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:48Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c53979-dbc9-4f9f-8fb4-871b0f8b6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c53979-dbc9-4f9f-8fb4-871b0f8b6633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5e3982-2c08-4077-aeb1-14d4051a8867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5e3982-2c08-4077-aeb1-14d4051a8867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe48e0a-4e90-4a1a-b933-7cab223fa5b6', 'volume_name': 'volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a26b42c-c4ee-46c6-a27b-2158dc5703ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a26b42c-c4ee-46c6-a27b-2158dc5703ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7714adf8-58d0-4bbf-b821-29202b0f0ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:48 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Volume afe48e0a-4e90-4a1a-b933-7cab223fa5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6', 'volume_size': 1} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:48 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a 1073741824" returned: 0 in 1.209s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:48 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a Jul 07 22:38:48 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (71977946-7fad-4f02-a892-f81fb188c95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7866e952-c731-4afc-be63-52e08531c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7866e952-c731-4afc-be63-52e08531c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1269664120',display_name='tempest-VolumesGetTest-Volume-1998962696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773af3a4-4199-4925-9375-65be97a13e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:49Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdec9a8e-e702-44cf-b028-b29285a0fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdec9a8e-e702-44cf-b028-b29285a0fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217ad12-fbea-4248-8db6-225d6a5ac00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217ad12-fbea-4248-8db6-225d6a5ac00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773af3a4-4199-4925-9375-65be97a13e8e', 'volume_name': 'volume-773af3a4-4199-4925-9375-65be97a13e8e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f8a517-d92b-4cb2-b4eb-62710f986786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f8a517-d92b-4cb2-b4eb-62710f986786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c700c5f5-4069-4779-8474-f368597a5973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Volume 773af3a4-4199-4925-9375-65be97a13e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773af3a4-4199-4925-9375-65be97a13e8e', 'volume_size': 1} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:49 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a" returned: 0 in 0.729s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659966080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe48e0a-4e90-4a1a-b933-7cab223fa5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:48Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Creating volume afe48e0a-4e90-4a1a-b933-7cab223fa5b6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:49 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:49 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 1073741824 Jul 07 22:38:49 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7c7a23-8ed2-4abb-a175-5a0930d011b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6c04ae-1a99-4181-a3bc-018570057e6a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e845044-6c29-4462-a5e7-b93fe6f4dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Volume volume-9e6c04ae-1a99-4181-a3bc-018570057e6a (9e6c04ae-1a99-4181-a3bc-018570057e6a): created successfully Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e845044-6c29-4462-a5e7-b93fe6f4dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Flow 'volume_create_manager' (3c213e4e-b1c3-4f7f-bd02-dc05202d1791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a57797c5-6708-4584-9922-62fe6068546c tempest-SnapshotsActionsTest-821113518 None] Created volume successfully. Jul 07 22:38:50 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 1073741824" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:50 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 Jul 07 22:38:50 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:51 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.221s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1269664120',display_name='tempest-VolumesGetTest-Volume-1998962696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773af3a4-4199-4925-9375-65be97a13e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:49Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Creating volume 773af3a4-4199-4925-9375-65be97a13e8e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:51 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7714adf8-58d0-4bbf-b821-29202b0f0ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:51 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e 1073741824 Jul 07 22:38:51 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cb0d85-2fd5-4b1a-a6a0-71c5399867c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Volume volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 (afe48e0a-4e90-4a1a-b933-7cab223fa5b6): created successfully Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cb0d85-2fd5-4b1a-a6a0-71c5399867c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (3c7a676a-d397-48ae-b6c6-3c7a0054a253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a2bd18a1-d9ab-4f8b-a690-365e23df3c4a tempest-VolumesListAdminTestJSON-1406309401 None] Created volume successfully. Jul 07 22:38:52 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e 1073741824" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:52 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e Jul 07 22:38:52 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (b9ede3b8-7083-404b-829c-eda1522daded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e466d-ad62-4b56-ad95-6b85f1bd4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e466d-ad62-4b56-ad95-6b85f1bd4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1375933434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6decd593-c53a-43cc-b6c0-e7c943441d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:53Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7517fe86-155a-42c4-9e9b-fb940c60d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7517fe86-155a-42c4-9e9b-fb940c60d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417741a-f5cb-437f-beb9-5da6512c6498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417741a-f5cb-437f-beb9-5da6512c6498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6decd593-c53a-43cc-b6c0-e7c943441d2a', 'volume_name': 'volume-6decd593-c53a-43cc-b6c0-e7c943441d2a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a164e0-e632-4ccb-b411-248c4452386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a164e0-e632-4ccb-b411-248c4452386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e44ec6-0cf3-4cb5-b33d-77382a6c8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:52 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Volume 6decd593-c53a-43cc-b6c0-e7c943441d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6decd593-c53a-43cc-b6c0-e7c943441d2a', 'volume_size': 1} Jul 07 22:38:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:53 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e" returned: 0 in 0.750s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c700c5f5-4069-4779-8474-f368597a5973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773af3a4-4199-4925-9375-65be97a13e8e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8abbf6f-9566-460f-9790-b9becfeef39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Creating offline snapshot 7610d152-eaad-4944-9b9b-5e3679b12a4e of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:38:53 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Volume volume-773af3a4-4199-4925-9375-65be97a13e8e (773af3a4-4199-4925-9375-65be97a13e8e): created successfully Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8abbf6f-9566-460f-9790-b9becfeef39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (71977946-7fad-4f02-a892-f81fb188c95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[42657cca-c841-44bc-b388-0f8e0a11ec1a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-549ecc04-54b8-4eb4-839b-bcab99b7cac5 tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:38:53 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a Jul 07 22:38:53 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-773af3a4-4199-4925-9375-65be97a13e8e-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "cinder-773af3a4-4199-4925-9375-65be97a13e8e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-773af3a4-4199-4925-9375-65be97a13e8e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-773af3a4-4199-4925-9375-65be97a13e8e" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ee188-15b8-4f99-b18a-b70894387c8b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:53 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e Jul 07 22:38:53 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:54 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a" returned: 0 in 1.013s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:54 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e 1G Jul 07 22:38:54 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:54 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e" returned: 0 in 0.891s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:54 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e Jul 07 22:38:54 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:55 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e 1G" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:55 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:38:55 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:55 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-773af3a4-4199-4925-9375-65be97a13e8e" returned: 0 in 0.729s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-773af3a4-4199-4925-9375-65be97a13e8e" released by "delete_volume" :: held 1.688s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Created reservations ['0def23b0-16a3-4e49-9725-ccc4120f7203', 'c24a7b16-a9d7-4e92-a5dc-bdd2d8f43313', '725c12e5-023d-4343-973d-d3c6f369ade7', 'ed591c34-6077-4290-9b9b-29e9add59c17'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:55 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:55 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-473090da-7817-4d02-8d51-ec1d8a2a6abf req-d77c76d8-8926-4d53-a4e6-49908a964545 tempest-AttachVolumeNegativeTest-1968883960 None] Terminate volume connection completed successfully. Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-473090da-7817-4d02-8d51-ec1d8a2a6abf req-d77c76d8-8926-4d53-a4e6-49908a964545 tempest-AttachVolumeNegativeTest-1968883960 None] Deleting attachment 29ba1f85-fe8c-4123-9ede-4f37cd227ac1. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-6c16e0fc-4659-46c3-a2c0-2260c80e8635-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:55 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.853s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:55 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e is being set with open permissions: ugo+rw Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "cinder-6c16e0fc-4659-46c3-a2c0-2260c80e8635-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:55 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:38:55 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-6c16e0fc-4659-46c3-a2c0-2260c80e8635" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-6c16e0fc-4659-46c3-a2c0-2260c80e8635" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc30d8-5e48-4789-bb4d-08001921b052]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:56 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.767s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ff96c30-840b-46c0-88b5-ffa4deae57b7 tempest-VolumesGetTest-57541229 None] Lock "cinder-773af3a4-4199-4925-9375-65be97a13e8e-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:56 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 Jul 07 22:38:56 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:56 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.786s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:56 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info Jul 07 22:38:56 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:56 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635" returned: 0 in 0.860s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:56 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635 Jul 07 22:38:56 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:57 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:57 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info is being set with open permissions: ugo+rw Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:57 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info Jul 07 22:38:57 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:57 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6c16e0fc-4659-46c3-a2c0-2260c80e8635" returned: 0 in 0.680s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-6c16e0fc-4659-46c3-a2c0-2260c80e8635" released by "delete_volume" :: held 1.596s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Created reservations ['d2ee1ed9-6c9d-40a8-a6c3-64d48ac138e8', '2da961b9-d3da-498a-b24d-ffb1f0b159d8', 'aa2b44ba-9a8e-4f89-83bc-64872eb819eb', 'ca4b1d85-8765-4d59-bfb0-94140098d489'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:57 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:38:57 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:58 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.info" returned: 0 in 0.790s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.228s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.537s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1375933434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6decd593-c53a-43cc-b6c0-e7c943441d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae99bd7470cb47948cad2c17c090dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:53Z,use_quota=True,user_id='9821ffb65f294ca993f411b0380f025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Creating volume 6decd593-c53a-43cc-b6c0-e7c943441d2a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:58 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:58 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a 1073741824 Jul 07 22:38:58 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c5367198-aa02-4da9-b808-fe3bd652470f tempest-SnapshotsActionsTest-821113518 None] Create snapshot completed successfully Jul 07 22:38:58 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.836s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-48f7b69e-f1b3-4829-85d4-f4bca8e3dc3a tempest-VolumesGetTest-57541229 None] Lock "cinder-6c16e0fc-4659-46c3-a2c0-2260c80e8635-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (6f5af437-a533-4926-a0b2-9ab913b57fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c310a6f8-6a18-4212-8c16-730138fc6cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c310a6f8-6a18-4212-8c16-730138fc6cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-517024433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8952fcc8-e307-4643-98c7-e8ba9cdb230a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:59Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b956c-bcea-49bf-b48e-afeeb40a13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b956c-bcea-49bf-b48e-afeeb40a13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327e61d0-8e7d-42b3-be0b-924e0379198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327e61d0-8e7d-42b3-be0b-924e0379198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'volume_name': 'volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25621117-9bcf-4ecd-84bc-84047c58e36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25621117-9bcf-4ecd-84bc-84047c58e36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301c056c-f71d-4bf8-914e-2340a7415ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Volume 8952fcc8-e307-4643-98c7-e8ba9cdb230a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'volume_size': 1} Jul 07 22:38:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:59 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a 1073741824" returned: 0 in 0.992s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:59 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a Jul 07 22:38:59 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:00 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a" returned: 0 in 0.945s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-517024433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8952fcc8-e307-4643-98c7-e8ba9cdb230a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:59Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Creating volume 8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:00 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:00 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a 1073741824 Jul 07 22:39:00 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e44ec6-0cf3-4cb5-b33d-77382a6c8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6decd593-c53a-43cc-b6c0-e7c943441d2a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc0f6cb-39b2-46cb-889e-ea47dc67b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Volume volume-6decd593-c53a-43cc-b6c0-e7c943441d2a (6decd593-c53a-43cc-b6c0-e7c943441d2a): created successfully Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc0f6cb-39b2-46cb-889e-ea47dc67b515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Flow 'volume_create_manager' (b9ede3b8-7083-404b-829c-eda1522daded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-216c08c9-20ec-4044-b048-41805071d672 tempest-VolumesListAdminTestJSON-1406309401 None] Created volume successfully. Jul 07 22:39:01 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a 1073741824" returned: 0 in 1.102s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:01 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:01 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Flow 'volume_create_manager' (aef30043-15a8-4313-95b4-dc01fdc4ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24eeee5-0be8-49aa-9fde-d63fed53c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24eeee5-0be8-49aa-9fde-d63fed53c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2007149-abe4-4d66-ab09-57e29c86845f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b6103115134120acf1ea2b03536ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:02Z,use_quota=True,user_id='beef02a2849c41bf83f0cc71969d2059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc8c0ab-009f-4d04-98a4-61de62280e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc8c0ab-009f-4d04-98a4-61de62280e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92408bf7-14a0-4f0d-be67-0bf9082b8db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92408bf7-14a0-4f0d-be67-0bf9082b8db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2007149-abe4-4d66-ab09-57e29c86845f', 'volume_name': 'volume-d2007149-abe4-4d66-ab09-57e29c86845f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5c6d22-255a-49da-833b-5353d9e55783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5c6d22-255a-49da-833b-5353d9e55783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a55ded-fe98-463e-b18f-0bdcf81ba146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Volume d2007149-abe4-4d66-ab09-57e29c86845f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2007149-abe4-4d66-ab09-57e29c86845f', 'volume_size': 1} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:02 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.261s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Creating offline snapshot a1a80feb-390a-4637-b119-0d2b008db383 of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301c056c-f71d-4bf8-914e-2340a7415ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5176a9a-17fd-4221-81b0-cec33517c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf440c-7595-41d8-bddd-4cfeea8f7f0d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Volume volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a (8952fcc8-e307-4643-98c7-e8ba9cdb230a): created successfully Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5176a9a-17fd-4221-81b0-cec33517c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (6f5af437-a533-4926-a0b2-9ab913b57fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3b7c63b8-4d50-414c-b88b-74f01b1b8c38 tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:39:02 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:02 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:03 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.974s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:03 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 1G Jul 07 22:39:03 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (75b31cf7-c9ac-4a23-bab3-ce9dba449ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532573e7-e892-4673-8c35-7cdf210d8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532573e7-e892-4673-8c35-7cdf210d8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-370204986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909005c5-9b8e-4d2d-8215-d684a6381328,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8952fcc8-e307-4643-98c7-e8ba9cdb230a,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:04Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d657e8e-d456-4749-9e00-981521cb97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d657e8e-d456-4749-9e00-981521cb97b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd624d1e-b299-4849-a101-531ec780203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd624d1e-b299-4849-a101-531ec780203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '909005c5-9b8e-4d2d-8215-d684a6381328', 'volume_name': 'volume-909005c5-9b8e-4d2d-8215-d684a6381328', 'volume_size': 1, 'source_volid': '8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'source_volstatus': 'available'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f84e4-a6ec-47e0-ac26-7061b6093637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f84e4-a6ec-47e0-ac26-7061b6093637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da18564d-b7bd-4c9a-9709-8d5c09221cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:03 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Volume 909005c5-9b8e-4d2d-8215-d684a6381328: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-909005c5-9b8e-4d2d-8215-d684a6381328', 'volume_size': 1, 'source_volid': '8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'source_volstatus': 'available'} Jul 07 22:39:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:04 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 1G" returned: 0 in 1.024s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:04 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 Jul 07 22:39:04 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:05 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383" returned: 0 in 0.742s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:05 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 is being set with open permissions: ugo+rw Jul 07 22:39:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:05 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 Jul 07 22:39:05 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:05 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383" returned: 0 in 0.797s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.675s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2007149-abe4-4d66-ab09-57e29c86845f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b6103115134120acf1ea2b03536ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:02Z,use_quota=True,user_id='beef02a2849c41bf83f0cc71969d2059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Creating volume d2007149-abe4-4d66-ab09-57e29c86845f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:06 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:06 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f 1073741824 Jul 07 22:39:06 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-43ec12c2-44e1-434b-98c7-9c2e77f979e3 tempest-SnapshotsActionsTest-821113518 None] Create snapshot completed successfully Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-a1a80feb-390a-4637-b119-0d2b008db383-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-a1a80feb-390a-4637-b119-0d2b008db383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-a1a80feb-390a-4637-b119-0d2b008db383" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-a1a80feb-390a-4637-b119-0d2b008db383" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Deleting offline snapshot a1a80feb-390a-4637-b119-0d2b008db383 of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] snapshot_file for this snap is: volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4952258-b97e-4c82-9706-cc44df2d7e97]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:06 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 Jul 07 22:39:06 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:07 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f 1073741824" returned: 0 in 1.255s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:07 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f Jul 07 22:39:07 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:07 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383" returned: 0 in 1.135s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96494f-7a6c-4f0e-a790-f103abc3e6c9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:08 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:08 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:08 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.329s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:08 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Cloning volume 8952fcc8-e307-4643-98c7-e8ba9cdb230a to volume 909005c5-9b8e-4d2d-8215-d684a6381328 Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a55ded-fe98-463e-b18f-0bdcf81ba146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2007149-abe4-4d66-ab09-57e29c86845f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58307e92-df7d-497e-a963-2db75ace98e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Creating offline snapshot 5a18e4b4-fbbb-44d2-ac0b-b075bedca439 of volume 8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Volume volume-d2007149-abe4-4d66-ab09-57e29c86845f (d2007149-abe4-4d66-ab09-57e29c86845f): created successfully Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58307e92-df7d-497e-a963-2db75ace98e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Flow 'volume_create_manager' (aef30043-15a8-4313-95b4-dc01fdc4ceee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81376d0-a701-4afe-932d-a791e3a9fdbf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7c725292-6693-4f58-9254-04c4aade30b3 tempest-VolumesListAdminTestJSON-476949352 None] Created volume successfully. Jul 07 22:39:08 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:08 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:08 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.931s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:08 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Acquiring lock "cinder-d2007149-abe4-4d66-ab09-57e29c86845f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:08 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "cinder-d2007149-abe4-4d66-ab09-57e29c86845f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Acquiring lock "cinder-quobyte-d2007149-abe4-4d66-ab09-57e29c86845f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "cinder-quobyte-d2007149-abe4-4d66-ab09-57e29c86845f" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[54baf934-4a57-4a99-ae61-dc0ba0e784fe]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-6decd593-c53a-43cc-b6c0-e7c943441d2a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-6decd593-c53a-43cc-b6c0-e7c943441d2a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:09 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f Jul 07 22:39:09 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-quobyte-6decd593-c53a-43cc-b6c0-e7c943441d2a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-6decd593-c53a-43cc-b6c0-e7c943441d2a" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e1a4b-bdc0-4da6-b819-2f1eee8530f1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:09 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 1.142s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:09 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a Jul 07 22:39:09 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:09 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 1G Jul 07 22:39:09 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:09 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f" returned: 0 in 0.963s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:09 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f Jul 07 22:39:09 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:10 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383" returned: 0 in 1.241s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:10 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383 Jul 07 22:39:10 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:10 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a" returned: 0 in 1.306s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:10 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a Jul 07 22:39:10 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:10 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 1G" returned: 0 in 1.269s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:10 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:10 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:10 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d2007149-abe4-4d66-ab09-57e29c86845f" returned: 0 in 1.036s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "cinder-quobyte-d2007149-abe4-4d66-ab09-57e29c86845f" released by "delete_volume" :: held 2.064s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:11 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.a1a80feb-390a-4637-b119-0d2b008db383" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-a1a80feb-390a-4637-b119-0d2b008db383" released by "_delete_snapshot" :: held 4.464s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Created reservations ['67ccab46-23b1-486f-8a08-b00202858c93', '3f881100-ab0f-49ac-9bcc-22c992255483', '3930b176-7681-4317-a2cd-3226c893fd4c', 'b0da73a5-3c27-4d88-86a9-594f244ae72c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_snapshot" :: held 4.511s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Created reservations ['2aa4d8ad-e0bc-4752-bc8d-318101461a10', 'b2d92d12-6085-4665-b0ce-4205f8011fea', 'a3e9e762-ec77-46b7-8199-f4a607402314', 'cc466d1f-a938-49ab-ad10-9dc377715ebd'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:11 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:11 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Delete snapshot completed successfully. Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf124b2f-d2f2-4dd5-ab3c-734ba241bdee tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-a1a80feb-390a-4637-b119-0d2b008db383-delete_snapshot" released by "delete_snapshot" :: held 4.819s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:11 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6decd593-c53a-43cc-b6c0-e7c943441d2a" returned: 0 in 1.143s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:11 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 1.035s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:11 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 is being set with open permissions: ugo+rw Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-6decd593-c53a-43cc-b6c0-e7c943441d2a" released by "delete_volume" :: held 2.527s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:11 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:11 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Created reservations ['209603de-8733-4643-b5a0-f00ee8372b7d', '454732a0-6f2a-4265-b490-7617515cf2af', 'eab1d523-5f5f-4f14-885c-44dbeb58fe88', '5a9272f7-886a-48fd-b3f2-274dc34c605f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:11 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:11 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:12 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.840s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Deleted volume successfully. Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e778eb4-1153-41b1-8063-015d0094b126 tempest-VolumesListAdminTestJSON-476949352 None] Lock "cinder-d2007149-abe4-4d66-ab09-57e29c86845f-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:12 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:12 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info Jul 07 22:39:12 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-afe48e0a-4e90-4a1a-b933-7cab223fa5b6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-afe48e0a-4e90-4a1a-b933-7cab223fa5b6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-quobyte-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae8214a-9c5c-4120-b9b5-59244475ef1c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:12 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Deleted volume successfully. Jul 07 22:39:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-19c9b2a9-d930-4156-b894-22de2b243891 tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-6decd593-c53a-43cc-b6c0-e7c943441d2a-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:12 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 Jul 07 22:39:12 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:13 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info" returned: 0 in 0.738s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:13 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info is being set with open permissions: ugo+rw Jul 07 22:39:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:13 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info Jul 07 22:39:13 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:13 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" returned: 0 in 0.825s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:13 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6 Jul 07 22:39:13 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:13 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.info" returned: 0 in 0.726s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] snapshot: 5a18e4b4-fbbb-44d2-ac0b-b075bedca439, volume: 909005c5-9b8e-4d2d-8215-d684a6381328, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8345fbbf-767b-48d4-9166-17306305f1d9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:14 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:14 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:14 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-afe48e0a-4e90-4a1a-b933-7cab223fa5b6" released by "delete_volume" :: held 1.619s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Created reservations ['5497e35b-7860-48c5-bdab-14a2d992ba85', '361c493a-389c-4713-abe3-74d96c138c49', '1737c181-49de-4224-87ca-7523965d2245', 'de992175-5c45-43af-ba21-0cbf1682233a'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:14 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:14 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:14 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 0.895s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f171f3e-da32-43b7-b4f9-b9c4c3f1a4aa]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "cinder-quobyte-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce48da-3164-44ea-b664-55ac6bd905a5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:15 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:15 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:15 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Deleted volume successfully. Jul 07 22:39:15 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b Jul 07 22:39:15 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e87fded1-ebc9-43d1-8979-80eef8373a9b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-afe48e0a-4e90-4a1a-b933-7cab223fa5b6-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:15 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:15 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:16 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" returned: 0 in 0.983s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:16 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 1.171s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:16 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b Jul 07 22:39:16 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:16 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 Jul 07 22:39:16 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:16 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.086s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:39:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:39:17 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" returned: 0 in 0.906s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-quobyte-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b" released by "delete_volume" :: held 1.967s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Created reservations ['0115c968-9c62-400b-8fae-d05069a5e09a', 'b91feb64-caa1-4202-9fec-6927c6e513bc', 'b0f9459a-9b54-4486-bbe3-2aead1c96cb4', 'e102e302-e441-4035-9de2-9278dbe29a96'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:17 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:17 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:19 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 2.046s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:19 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Deleted volume successfully. Jul 07 22:39:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0d17c96b-a584-43c6-9fcb-1e8e1eedd26b tempest-VolumesListAdminTestJSON-1406309401 None] Lock "cinder-1d1eaf37-cafe-4a2f-93e3-81e15f694c4b-delete_volume" released by "delete_volume" :: held 4.465s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:22 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328" returned: 0 in 6.651s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f742a6-dd4f-4981-8631-650ce4441e1e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:22 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:22 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:24 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 1.436s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:24 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:39:24 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Converted 1024.00 MB image at 153.92 MB/s Jul 07 22:39:24 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 is being set with open permissions: ugo+rw Jul 07 22:39:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:24 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 Jul 07 22:39:24 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:25 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" released by "_copy_volume_from_snapshot" :: held 11.085s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-5a18e4b4-fbbb-44d2-ac0b-b075bedca439" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-5a18e4b4-fbbb-44d2-ac0b-b075bedca439" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Deleting offline snapshot 5a18e4b4-fbbb-44d2-ac0b-b075bedca439 of volume 8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] snapshot_file for this snap is: volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[088afcba-7b2c-40e0-aee1-7b4c893e0c9a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:25 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:25 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:26 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:26 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f4925-f0d4-4d47-839c-444c58611d95]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:26 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:26 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:27 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 1.072s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:27 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:27 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:27 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=106,cinder:UPDATE=101,cinder:INSERT=27,cinder:DELETE=9 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:39:28 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 1.101s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:28 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439 Jul 07 22:39:28 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:29 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a.5a18e4b4-fbbb-44d2-ac0b-b075bedca439" returned: 0 in 1.053s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-5a18e4b4-fbbb-44d2-ac0b-b075bedca439" released by "_delete_snapshot" :: held 4.250s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.312s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.161s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Creating offline snapshot f1f9b8c7-3e79-4cd5-bda3-4765272643ac of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da18564d-b7bd-4c9a-9709-8d5c09221cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909005c5-9b8e-4d2d-8215-d684a6381328', 'volume_size': 1, 'source_volid': '8952fcc8-e307-4643-98c7-e8ba9cdb230a', 'source_volstatus': 'available'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26202fa9-ee75-4218-8889-c09382c64b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa51e28-30e4-4977-ac10-5db968e3a531]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Volume volume-909005c5-9b8e-4d2d-8215-d684a6381328 (909005c5-9b8e-4d2d-8215-d684a6381328): created successfully Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26202fa9-ee75-4218-8889-c09382c64b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (75b31cf7-c9ac-4a23-bab3-ce9dba449ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-01859169-5a49-42db-b542-78f4aa3c3d5b tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:39:29 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:29 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:30 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 1.089s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:30 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac 1G Jul 07 22:39:30 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (8fd4c566-31aa-451e-98ac-3d7eae5be905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d3af4-8fd1-43b7-827f-8f208ee8cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac 1G" returned: 0 in 1.039s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:31 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d3af4-8fd1-43b7-827f-8f208ee8cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-99621471',display_name='tempest-VolumesGetTest-Volume-1466130435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51acfce8-caf5-4528-a21e-160db16befa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f19abe2-7980-4a06-af71-9c36a46342ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f19abe2-7980-4a06-af71-9c36a46342ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c749a2-eeae-4613-82e4-eb457c12bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c749a2-eeae-4613-82e4-eb457c12bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51acfce8-caf5-4528-a21e-160db16befa6', 'volume_name': 'volume-51acfce8-caf5-4528-a21e-160db16befa6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36c73ce-749b-42cf-b9b9-59589a53daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36c73ce-749b-42cf-b9b9-59589a53daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9a631-7e3d-4755-903d-f2b7f1a4662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Volume 51acfce8-caf5-4528-a21e-160db16befa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51acfce8-caf5-4528-a21e-160db16befa6', 'volume_size': 1} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Flow 'volume_create_manager' (0d1e98b3-3bf8-4431-a2ed-f5d32896dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264194aa-54da-49fa-8bdb-fb90185af101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264194aa-54da-49fa-8bdb-fb90185af101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-950113119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f368ee-bf8c-4f05-b207-5df0618e7235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32088bd53751499da74e446b755ad027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='aaef78abaed94d08b01c28200365747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3b32dc-d0ef-4758-add7-a738385369ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3b32dc-d0ef-4758-add7-a738385369ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807bb4b3-69b7-47ea-ad6c-65eabc7d6bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807bb4b3-69b7-47ea-ad6c-65eabc7d6bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f368ee-bf8c-4f05-b207-5df0618e7235', 'volume_name': 'volume-a5f368ee-bf8c-4f05-b207-5df0618e7235', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d39aa4-5b45-4c69-8b52-c6880f6aaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d39aa4-5b45-4c69-8b52-c6880f6aaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d0caed-721c-4aa4-ae40-e5d42bc5a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Volume a5f368ee-bf8c-4f05-b207-5df0618e7235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f368ee-bf8c-4f05-b207-5df0618e7235', 'volume_size': 1} Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:32 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac" returned: 0 in 0.781s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac is being set with open permissions: ugo+rw Jul 07 22:39:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:32 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac Jul 07 22:39:32 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:33 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac" returned: 0 in 0.684s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.713s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-99621471',display_name='tempest-VolumesGetTest-Volume-1466130435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51acfce8-caf5-4528-a21e-160db16befa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Creating volume 51acfce8-caf5-4528-a21e-160db16befa6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:33 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:33 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 1073741824 Jul 07 22:39:33 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7fdf05ed-12b0-4a76-ab27-b1bc29a0e0c0 tempest-SnapshotsActionsTest-821113518 None] Create snapshot completed successfully Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-f1f9b8c7-3e79-4cd5-bda3-4765272643ac-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-f1f9b8c7-3e79-4cd5-bda3-4765272643ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-f1f9b8c7-3e79-4cd5-bda3-4765272643ac" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-f1f9b8c7-3e79-4cd5-bda3-4765272643ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Deleting offline snapshot f1f9b8c7-3e79-4cd5-bda3-4765272643ac of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] snapshot_file for this snap is: volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b2cbcb-98a0-4204-be4d-44df014d56b4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:33 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac Jul 07 22:39:33 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:34 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 1073741824" returned: 0 in 1.017s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:34 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 Jul 07 22:39:34 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:34 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac" returned: 0 in 0.911s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857e0f5-42b7-4002-960b-7099a7b8c122]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:34 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:34 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:35 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6" returned: 0 in 0.735s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.999s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-950113119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f368ee-bf8c-4f05-b207-5df0618e7235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32088bd53751499da74e446b755ad027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='aaef78abaed94d08b01c28200365747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Creating volume a5f368ee-bf8c-4f05-b207-5df0618e7235 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:35 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:35 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 1073741824 Jul 07 22:39:35 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9a631-7e3d-4755-903d-f2b7f1a4662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51acfce8-caf5-4528-a21e-160db16befa6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a7e2c0-26d8-4ae4-bff8-accee3d0278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Volume volume-51acfce8-caf5-4528-a21e-160db16befa6 (51acfce8-caf5-4528-a21e-160db16befa6): created successfully Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a7e2c0-26d8-4ae4-bff8-accee3d0278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (8fd4c566-31aa-451e-98ac-3d7eae5be905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0cb23851-2767-4c32-a3a3-6b73b75bcea6 tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:39:35 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.815s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:35 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac Jul 07 22:39:35 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-51acfce8-caf5-4528-a21e-160db16befa6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "cinder-51acfce8-caf5-4528-a21e-160db16befa6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:INSERT=32,cinder:SELECT=69,cinder:UPDATE=107,cinder:DELETE=12 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:39:36 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 1073741824" returned: 0 in 1.019s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-51acfce8-caf5-4528-a21e-160db16befa6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-51acfce8-caf5-4528-a21e-160db16befa6" acquired by "delete_volume" :: waited 0.075s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:36 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 Jul 07 22:39:36 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[debafe90-25cd-4404-bd68-f23cdafa8b88]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:36 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 Jul 07 22:39:36 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:36 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:36 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac Jul 07 22:39:36 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:36 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235" returned: 0 in 0.808s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d0caed-721c-4aa4-ae40-e5d42bc5a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f368ee-bf8c-4f05-b207-5df0618e7235', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111d5359-6c2f-4c94-8e2a-de06f94ec053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Volume volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 (a5f368ee-bf8c-4f05-b207-5df0618e7235): created successfully Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111d5359-6c2f-4c94-8e2a-de06f94ec053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Flow 'volume_create_manager' (0d1e98b3-3bf8-4431-a2ed-f5d32896dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-26c04b12-62cf-4e4a-ae9a-cb96a1c18de5 tempest-VolumesTransfersTest-1559026030 None] Created volume successfully. Jul 07 22:39:37 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6" returned: 0 in 0.994s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:37 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6 Jul 07 22:39:37 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:37 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.f1f9b8c7-3e79-4cd5-bda3-4765272643ac" returned: 0 in 0.874s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-f1f9b8c7-3e79-4cd5-bda3-4765272643ac" released by "_delete_snapshot" :: held 3.683s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_snapshot" :: held 3.711s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Created reservations ['7bcfced9-fe7d-44c7-b142-a5c70cae114f', '7844a918-a12a-43c2-b765-786a683fc36b', '3f01d654-eb45-4834-89a8-2ad058596c68', '0e6b0645-7aea-41f3-9209-c1c7286b3f18'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Delete snapshot completed successfully. Jul 07 22:39:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aae6adb3-b03c-419c-bb67-e4bc460cee85 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-f1f9b8c7-3e79-4cd5-bda3-4765272643ac-delete_snapshot" released by "delete_snapshot" :: held 3.969s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:38 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-51acfce8-caf5-4528-a21e-160db16befa6" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-51acfce8-caf5-4528-a21e-160db16befa6" released by "delete_volume" :: held 1.878s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Created reservations ['48ca3483-24d2-4f00-b63c-8db65a7cb82b', '1bbacb57-9395-4f68-926c-9e09abd67482', 'c6208957-3878-4efd-9bec-e67ee93bed81', '714406b7-d1b1-4298-b1aa-43f50a468ccc'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:38 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:38 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Creating offline snapshot cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:38 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e461371d-6093-4e4f-8ebc-40e14f3303c9 tempest-VolumesTransfersTest-140819900 None] Transfer volume completed successfully. Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4ebf3-a4e5-49fa-9715-84cca6f808e2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:38 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:38 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-909005c5-9b8e-4d2d-8215-d684a6381328-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "cinder-909005c5-9b8e-4d2d-8215-d684a6381328-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[108813a8-4810-41fe-9387-485492242b62]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:38 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 Jul 07 22:39:38 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:39 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.969s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5d3958c-77e0-4e1a-bd03-68cd259ae66a tempest-VolumesGetTest-57541229 None] Lock "cinder-51acfce8-caf5-4528-a21e-160db16befa6-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:39 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 1.019s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "cinder-a5f368ee-bf8c-4f05-b207-5df0618e7235-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:39 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b 1G Jul 07 22:39:39 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-a5f368ee-bf8c-4f05-b207-5df0618e7235-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "cinder-quobyte-a5f368ee-bf8c-4f05-b207-5df0618e7235" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-quobyte-a5f368ee-bf8c-4f05-b207-5df0618e7235" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[411916b1-25fc-4db6-b996-47002e2b0a64]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:39 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 Jul 07 22:39:39 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:39 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328" returned: 0 in 1.019s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:39 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328 Jul 07 22:39:39 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:40 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b 1G" returned: 0 in 0.968s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:40 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:40 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:40 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b Jul 07 22:39:40 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-909005c5-9b8e-4d2d-8215-d684a6381328" returned: 0 in 0.709s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-909005c5-9b8e-4d2d-8215-d684a6381328" released by "delete_volume" :: held 1.783s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:40 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235 Jul 07 22:39:40 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Created reservations ['92efcb52-1b19-48bf-9908-e53f267a5864', '7f1d3bf9-30c6-4d2e-a297-68d693a9f34c', 'c7777ee0-1134-4a58-a997-64eac4b78e2d', 'eecac475-b1d3-4edc-8806-63df31310184'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:40 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:40 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-8952fcc8-e307-4643-98c7-e8ba9cdb230a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "cinder-8952fcc8-e307-4643-98c7-e8ba9cdb230a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-8952fcc8-e307-4643-98c7-e8ba9cdb230a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-8952fcc8-e307-4643-98c7-e8ba9cdb230a" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabf44a8-6304-49e0-8207-fe91155d3ffd]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:41 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:41 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:41 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a5f368ee-bf8c-4f05-b207-5df0618e7235" returned: 0 in 0.787s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:41 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:41 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b is being set with open permissions: ugo+rw Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-quobyte-a5f368ee-bf8c-4f05-b207-5df0618e7235" released by "delete_volume" :: held 1.702s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:41 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b Jul 07 22:39:41 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Created reservations ['97d78547-4de3-4e6c-bdcf-8511d8bcf05e', '63f92385-f64e-4161-92ca-3e1555a31f05', 'a0b18c17-07a9-4a42-9000-23f3da4e33d1', 'd592bfe7-7b31-43bc-9570-097206f23b05'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:41 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:41 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:41 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.994s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:39:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-63e0f0e7-58cd-476f-8d74-88a2681f3a70 tempest-VolumesGetTest-57541229 None] Lock "cinder-909005c5-9b8e-4d2d-8215-d684a6381328-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:42 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 0.968s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:42 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a Jul 07 22:39:42 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:42 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" returned: 0 in 0.937s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.962s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:42 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7fb222de-de2f-432b-90ad-974da446b85d tempest-SnapshotsActionsTest-821113518 None] Create snapshot completed successfully Jul 07 22:39:42 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.912s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:42 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Deleted volume successfully. Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2a2a206-6c6c-45d9-b06c-4986572935ed tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-a5f368ee-bf8c-4f05-b207-5df0618e7235-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Flow 'volume_create_manager' (65ea2b79-82f1-4372-b254-0a216772b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548a57d-0fa2-48d3-93ac-c32b7b32a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548a57d-0fa2-48d3-93ac-c32b7b32a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-113241540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1be106-0eba-4d7b-bd53-f62486ff4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32088bd53751499da74e446b755ad027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:43Z,use_quota=True,user_id='aaef78abaed94d08b01c28200365747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ea826-d4df-4476-a095-4f32cb8ad81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ea826-d4df-4476-a095-4f32cb8ad81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0869fa5d-05fa-459d-ba4e-ad82dfbcbaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0869fa5d-05fa-459d-ba4e-ad82dfbcbaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1be106-0eba-4d7b-bd53-f62486ff4d05', 'volume_name': 'volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518c9158-420a-4d72-8b9e-6eb0a6a93311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518c9158-420a-4d72-8b9e-6eb0a6a93311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60521c7-9a1d-44dd-aa7d-97001a881897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Volume 6d1be106-0eba-4d7b-bd53-f62486ff4d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05', 'volume_size': 1} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-113241540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1be106-0eba-4d7b-bd53-f62486ff4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32088bd53751499da74e446b755ad027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:43Z,use_quota=True,user_id='aaef78abaed94d08b01c28200365747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Creating volume 6d1be106-0eba-4d7b-bd53-f62486ff4d05 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:42 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:42 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 1073741824 Jul 07 22:39:42 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Deleting offline snapshot cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] snapshot_file for this snap is: volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec28f2-ad34-4038-adb1-d113495c1fce]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:43 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8952fcc8-e307-4643-98c7-e8ba9cdb230a" returned: 0 in 0.943s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-8952fcc8-e307-4643-98c7-e8ba9cdb230a" released by "delete_volume" :: held 1.999s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:43 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b Jul 07 22:39:43 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Created reservations ['35ee2c3a-7f95-44ef-bb21-ba6288320351', '7356fe79-e1a3-47ae-890f-66e82bae12a2', 'd092de88-ce36-4eb7-900a-3f78b838912a', '60ea35ae-1bde-4f79-b900-6d2140f67054'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:43 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:43 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:43 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 1073741824" returned: 0 in 1.218s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:44 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 Jul 07 22:39:44 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:44 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" returned: 0 in 1.023s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37add18-5766-4e67-8f8a-cc4c015ce9d6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:44 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:44 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:44 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.988s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b09d7a76-ea21-4834-85f7-9ea15f5433a6 tempest-VolumesGetTest-57541229 None] Lock "cinder-8952fcc8-e307-4643-98c7-e8ba9cdb230a-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (e01e92d4-a011-4bb1-a7bc-15b1cbb7d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dc1bd7-8b76-44f1-8b84-96b81a82ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dc1bd7-8b76-44f1-8b84-96b81a82ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-203559217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c5824b-7f03-45e4-895d-2b0ae391d1b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:45Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b4c17d-f140-4260-9f8e-b123857ce11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b4c17d-f140-4260-9f8e-b123857ce11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3eca359-48c0-4ccc-b0a8-34db6ffb3ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:39:44 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05" returned: 0 in 0.925s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60521c7-9a1d-44dd-aa7d-97001a881897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e717e4-c46e-42be-a411-050a57a95497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Volume volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 (6d1be106-0eba-4d7b-bd53-f62486ff4d05): created successfully Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e717e4-c46e-42be-a411-050a57a95497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Flow 'volume_create_manager' (65ea2b79-82f1-4372-b254-0a216772b875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2a472fba-64ed-4726-85d4-89d8cd838673 tempest-VolumesTransfersTest-1559026030 None] Created volume successfully. Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3eca359-48c0-4ccc-b0a8-34db6ffb3ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9c5824b-7f03-45e4-895d-2b0ae391d1b3', 'volume_name': 'volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c01a01-62d8-4d7c-9972-fd3a760019a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c01a01-62d8-4d7c-9972-fd3a760019a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad90fa1-b8c8-40d3-ba29-bdd874535910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Trying to clone b9c5824b-7f03-45e4-895d-2b0ae391d1b3 from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:39:45 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 1.135s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:45 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b Jul 07 22:39:45 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:39:45 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[31709001-b1d7-40af-8d68-c07e7a260036]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:45 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD Jul 07 22:39:45 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "cinder-6d1be106-0eba-4d7b-bd53-f62486ff4d05-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-6d1be106-0eba-4d7b-bd53-f62486ff4d05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "cinder-quobyte-6d1be106-0eba-4d7b-bd53-f62486ff4d05" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-quobyte-6d1be106-0eba-4d7b-bd53-f62486ff4d05" acquired by "delete_volume" :: waited 0.013s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b9f5c6-b1b0-4848-a603-254f426f65e0]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:46 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 Jul 07 22:39:46 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:46 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" returned: 0 in 1.101s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:46 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b Jul 07 22:39:46 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:46 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD" returned: 0 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 is fetched for user 4a68ed5f903547fc9de5ac39cab5087d. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1047a0-6f98-4900-923e-8adf32797a8b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:46 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD Jul 07 22:39:46 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:46 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05" returned: 0 in 0.800s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:47 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05 Jul 07 22:39:47 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:47 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" returned: 0 in 0.746s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b" released by "_delete_snapshot" :: held 4.153s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_snapshot" :: held 4.191s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Created reservations ['be91aee8-ad3b-4ae8-8fc9-1cf7dd948274', 'c9806dc5-13f2-4a98-b7ad-34335e36c661', '71d72137-c8e9-41c4-85e4-dc740e14a567', '37840ec1-8646-42c8-91e1-e2ccaf3d7be9'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Delete snapshot completed successfully. Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-191f79ee-57af-43aa-9ffe-5f7746d9df59 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-cbdfcbd3-7c8f-44bb-97e9-6b7d3aec8b7b-delete_snapshot" released by "delete_snapshot" :: held 4.376s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:47 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD" returned: 0 in 0.785s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-203559217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c5824b-7f03-45e4-895d-2b0ae391d1b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:45Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Creating volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:47 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:47 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1073741824 Jul 07 22:39:47 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:47 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6d1be106-0eba-4d7b-bd53-f62486ff4d05" returned: 0 in 0.654s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-quobyte-6d1be106-0eba-4d7b-bd53-f62486ff4d05" released by "delete_volume" :: held 1.504s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Created reservations ['e1436d68-e204-4d50-a056-2dbb2e97bf53', 'c2f0ae9b-ea99-44e8-b8b3-d0c999f3b7d8', '13bc0c79-5a6f-4449-9ff1-2ac5b0ff99fc', '178f5d3b-ace7-4a3f-8744-6b5566b03b30'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:47 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:39:47 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:48 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1073741824" returned: 0 in 0.972s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:48 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.771s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Deleted volume successfully. Jul 07 22:39:48 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:39:48 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-199301b0-307c-4a7e-a4f5-5ee077e87bfe tempest-VolumesTransfersTest-1842801968 None] Lock "cinder-6d1be106-0eba-4d7b-bd53-f62486ff4d05-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:49 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 0 in 0.887s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.910s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Creating offline snapshot cd35b3ca-3237-43c2-8403-2dc2e9858a16 of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Attempting download of bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb9f07-9a98-4398-bc0e-76a3925824d2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (ba62a9b7-7e7d-45dc-b06c-e267948d504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b087b1a2-3cb9-471a-888b-9442537b0450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9d2440-1d64-4110-8bf2-3dd7a98b4890]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b087b1a2-3cb9-471a-888b-9442537b0450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1601568839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723f69fe-7dc0-4a41-ac71-bdbd5a36010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:50Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:49 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008be65e-a39c-4ab6-9cf1-1c8453a1c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008be65e-a39c-4ab6-9cf1-1c8453a1c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8788854e-6212-4a61-97e7-1161653c3096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8788854e-6212-4a61-97e7-1161653c3096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723f69fe-7dc0-4a41-ac71-bdbd5a36010f', 'volume_name': 'volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff8b9d2-4fbf-4205-8272-ea9e76ed9193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff8b9d2-4fbf-4205-8272-ea9e76ed9193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcd36e0-9fc1-4543-8d7a-7d777598b263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Volume 723f69fe-7dc0-4a41-ac71-bdbd5a36010f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f', 'volume_size': 1} Jul 07 22:39:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:49 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu Jul 07 22:39:49 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:50 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.909s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:50 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 1G Jul 07 22:39:50 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:50 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu" returned: 0 in 0.940s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:50 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu Jul 07 22:39:50 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:51 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 1G" returned: 0 in 1.004s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:51 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 Jul 07 22:39:51 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:51 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu" returned: 1 in 0.926s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_iephc5bu' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185474e-66b4-4802-bd39-59cd16214a83]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:51 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD Jul 07 22:39:51 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:52 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:52 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 is being set with open permissions: ugo+rw Jul 07 22:39:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:52 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 Jul 07 22:39:52 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:52 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD" returned: 0 in 0.913s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:52 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 was qcow2, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:39:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:52 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:39:52 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:53 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16" returned: 0 in 0.888s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.791s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.481s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1601568839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723f69fe-7dc0-4a41-ac71-bdbd5a36010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:50Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Creating volume 723f69fe-7dc0-4a41-ac71-bdbd5a36010f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:53 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f 1073741824 Jul 07 22:39:53 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8b445c13-3ddc-409a-af86-0528ddf7a7d1 tempest-SnapshotsActionsTest-821113518 None] Create snapshot completed successfully Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-cd35b3ca-3237-43c2-8403-2dc2e9858a16-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-cd35b3ca-3237-43c2-8403-2dc2e9858a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Acquiring lock "cinder-quobyte-cd35b3ca-3237-43c2-8403-2dc2e9858a16" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-cd35b3ca-3237-43c2-8403-2dc2e9858a16" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Deleting offline snapshot cd35b3ca-3237-43c2-8403-2dc2e9858a16 of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] snapshot_file for this snap is: volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[420678c4-a71f-4d7a-9a2f-0273a2090825]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:54 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 Jul 07 22:39:54 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:54 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f 1073741824" returned: 0 in 1.156s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:54 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f Jul 07 22:39:54 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:55 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 0 in 2.557s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_3wiswtb_devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:39:55 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Converted 112.00 MB image at 43.78 MB/s Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:55 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1G Jul 07 22:39:55 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:55 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" returned: 0 in 0.803s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:55 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16" returned: 0 in 1.084s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcd36e0-9fc1-4543-8d7a-7d777598b263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e499e7-bf61-4258-b87b-0ce38e9b565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[69565911-4e79-473c-88be-a0f55232e153]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Volume volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f (723f69fe-7dc0-4a41-ac71-bdbd5a36010f): created successfully Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e499e7-bf61-4258-b87b-0ce38e9b565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (ba62a9b7-7e7d-45dc-b06c-e267948d504b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dfdbbfef-583c-4bdf-8717-02956212d0fa tempest-AttachVolumeNegativeTest-1968883960 None] Created volume successfully. Jul 07 22:39:55 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:55 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:56 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 1G" returned: 0 in 0.897s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[784df23a-7ab3-4136-bef9-bfb7a08b61db]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:56 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:39:56 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:56 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.970s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:56 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 Jul 07 22:39:56 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:56 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 0 in 0.898s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:57 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:39:57 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:57 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16" returned: 0 in 0.909s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:57 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16 Jul 07 22:39:57 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Flow 'volume_create_manager' (421eb006-b689-4e0f-a53f-200966f4d663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31c07f-8b24-4709-8912-37f4cbeae1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31c07f-8b24-4709-8912-37f4cbeae1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1082054074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d7249-e7fc-450c-aac2-3221ca47a590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81571797613f4dbaa2bc98b77b37f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:57Z,use_quota=True,user_id='c8eef2906f60449796b049a289a97692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2569112e-ef17-44a6-91ce-ee843d3d4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2569112e-ef17-44a6-91ce-ee843d3d4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c9a0d9-23da-4a23-a8b6-2165ecc8904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c9a0d9-23da-4a23-a8b6-2165ecc8904a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254d7249-e7fc-450c-aac2-3221ca47a590', 'volume_name': 'volume-254d7249-e7fc-450c-aac2-3221ca47a590', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d86301-d2cb-419d-8069-e13f9d4e57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d86301-d2cb-419d-8069-e13f9d4e57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e8ab2b-08c6-4a14-aab4-473a18cbf4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Volume 254d7249-e7fc-450c-aac2-3221ca47a590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254d7249-e7fc-450c-aac2-3221ca47a590', 'volume_size': 1} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1082054074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d7249-e7fc-450c-aac2-3221ca47a590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81571797613f4dbaa2bc98b77b37f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:57Z,use_quota=True,user_id='c8eef2906f60449796b049a289a97692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Creating volume 254d7249-e7fc-450c-aac2-3221ca47a590 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:57 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:57 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 1073741824 Jul 07 22:39:57 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:57 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 1 in 0.890s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Downloaded image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 for user 4a68ed5f903547fc9de5ac39cab5087d is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Marking volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Copying metadata from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 to b9c5824b-7f03-45e4-895d-2b0ae391d1b3. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Creating volume glance metadata for volume b9c5824b-7f03-45e4-895d-2b0ae391d1b3 backed by image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:39:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad90fa1-b8c8-40d3-ba29-bdd874535910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988a9a9d-0ae4-4276-9b1e-05f64870a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Volume volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 (b9c5824b-7f03-45e4-895d-2b0ae391d1b3): created successfully Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988a9a9d-0ae4-4276-9b1e-05f64870a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (e01e92d4-a011-4bb1-a7bc-15b1cbb7d998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bbe34e48-a9b7-4782-bf37-d2e8e5be5a2a tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:39:58 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.cd35b3ca-3237-43c2-8403-2dc2e9858a16" returned: 0 in 0.798s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-cd35b3ca-3237-43c2-8403-2dc2e9858a16" released by "_delete_snapshot" :: held 3.885s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_snapshot" :: held 3.913s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Created reservations ['67e54161-bafa-4faa-b7b6-f736d4b31422', '2c1e41e1-2dbe-478d-926a-40b2e1e8756d', 'ae6aa14c-93e2-4318-a647-77e2f62a614a', 'f6aa2e7d-746a-4c46-bf48-28a1c10b4ed6'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Delete snapshot completed successfully. Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e9d72c35-633f-4b67-a786-00fc0a319e81 tempest-SnapshotsActionsTest-1869215894 None] Lock "cinder-cd35b3ca-3237-43c2-8403-2dc2e9858a16-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:58 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 1073741824" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:58 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 Jul 07 22:39:58 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "cinder-7610d152-eaad-4944-9b9b-5e3679b12a4e-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-7610d152-eaad-4944-9b9b-5e3679b12a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "cinder-quobyte-7610d152-eaad-4944-9b9b-5e3679b12a4e" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-7610d152-eaad-4944-9b9b-5e3679b12a4e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Deleting offline snapshot 7610d152-eaad-4944-9b9b-5e3679b12a4e of volume 9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] snapshot_file for this snap is: volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca357b-a463-4396-beef-5c17ab85c726]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:59 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:39:59 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:59 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590" returned: 0 in 0.748s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e8ab2b-08c6-4a14-aab4-473a18cbf4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254d7249-e7fc-450c-aac2-3221ca47a590', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7bfbd3-fbfa-4a1b-aded-ddea769f40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Volume volume-254d7249-e7fc-450c-aac2-3221ca47a590 (254d7249-e7fc-450c-aac2-3221ca47a590): created successfully Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7bfbd3-fbfa-4a1b-aded-ddea769f40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Flow 'volume_create_manager' (421eb006-b689-4e0f-a53f-200966f4d663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5abb823f-801e-4d5c-8b09-43d846537c63 tempest-VolumesTransfersV357Test-735479814 None] Created volume successfully. Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e15a5c-0e44-4f6e-ba8d-4236423e8607]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:59 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f Jul 07 22:39:59 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (a45872eb-17d2-4e34-af1c-47c56868e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d164f1c-8268-4a67-ae38-af45b6745d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d164f1c-8268-4a67-ae38-af45b6745d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1389160347',display_name='tempest-VolumesGetTest-Volume-902621390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852c3609-052d-4559-abd1-8b2003eb1b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:00Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388c2623-ea9a-43f7-8557-8f23253a87e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388c2623-ea9a-43f7-8557-8f23253a87e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1a762f-9676-4795-a0f3-a7c8079e93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1a762f-9676-4795-a0f3-a7c8079e93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852c3609-052d-4559-abd1-8b2003eb1b97', 'volume_name': 'volume-852c3609-052d-4559-abd1-8b2003eb1b97', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2245d2-520e-415a-959d-04b6738f528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2245d2-520e-415a-959d-04b6738f528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cad4cd-19df-4185-ade0-3773a623a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Volume 852c3609-052d-4559-abd1-8b2003eb1b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852c3609-052d-4559-abd1-8b2003eb1b97', 'volume_size': 1} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:59 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.951s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e6c04ae-1a99-4181-a3bc-018570057e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf132ef5-3778-43ca-8108-191c66ad8ac8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:00 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a Jul 07 22:40:00 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7d6ef6a8-795b-4f0d-bd6d-a8c004a00a10 tempest-VolumesTransfersV357Test-729541421 None] Transfer volume completed successfully. Jul 07 22:40:00 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" returned: 0 in 0.885s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1389160347',display_name='tempest-VolumesGetTest-Volume-902621390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852c3609-052d-4559-abd1-8b2003eb1b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b02d8c44b0486689412d33572fa7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:00Z,use_quota=True,user_id='4a68ed5f903547fc9de5ac39cab5087d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Creating volume 852c3609-052d-4559-abd1-8b2003eb1b97 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:00 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:00 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 1073741824 Jul 07 22:40:00 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0a0cb3b-fbb6-4f00-845a-91712f229e52', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:40:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-4d87ede9-f9c6-476a-9d3b-5f199c2d07bf req-55d30184-7421-4853-a2df-f47ef718308f tempest-AttachVolumeNegativeTest-1968883960 None] attachment_update completed successfully. Jul 07 22:40:00 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:00 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:40:00 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:01 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "cinder-254d7249-e7fc-450c-aac2-3221ca47a590-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 1073741824" returned: 0 in 1.032s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-254d7249-e7fc-450c-aac2-3221ca47a590-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:01 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 Jul 07 22:40:01 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "cinder-quobyte-254d7249-e7fc-450c-aac2-3221ca47a590" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-quobyte-254d7249-e7fc-450c-aac2-3221ca47a590" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c1323-a453-4b01-a86a-6e558b35029a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:01 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 Jul 07 22:40:01 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:01 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 1.013s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:01 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e Jul 07 22:40:01 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:02 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cad4cd-19df-4185-ade0-3773a623a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852c3609-052d-4559-abd1-8b2003eb1b97', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7297dcf-9f04-47cc-a8c5-71bd2e29b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Volume volume-852c3609-052d-4559-abd1-8b2003eb1b97 (852c3609-052d-4559-abd1-8b2003eb1b97): created successfully Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7297dcf-9f04-47cc-a8c5-71bd2e29b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Flow 'volume_create_manager' (a45872eb-17d2-4e34-af1c-47c56868e046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b75a9095-ecdf-443f-8b3f-929b6ce59c12 tempest-VolumesGetTest-57541229 None] Created volume successfully. Jul 07 22:40:02 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590" returned: 0 in 0.934s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:02 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590 Jul 07 22:40:02 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:02 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a.7610d152-eaad-4944-9b9b-5e3679b12a4e" returned: 0 in 0.857s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-7610d152-eaad-4944-9b9b-5e3679b12a4e" released by "_delete_snapshot" :: held 3.799s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_snapshot" :: held 3.822s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Created reservations ['2b89cbce-30aa-49c7-9529-f6df1eb64e1a', 'cb8da0cb-d1c9-4d43-86ad-c079700ae3a4', 'da3381cb-2ffd-4e08-978e-a5ae1c2ba09a', '3ac5232c-24e9-4fe5-bd02-b452dd2368ae'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Delete snapshot completed successfully. Jul 07 22:40:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-70c99d2c-07c4-49ab-9324-310d5193c7a3 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-7610d152-eaad-4944-9b9b-5e3679b12a4e-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:03 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-254d7249-e7fc-450c-aac2-3221ca47a590" returned: 0 in 0.702s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-quobyte-254d7249-e7fc-450c-aac2-3221ca47a590" released by "delete_volume" :: held 1.680s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Created reservations ['bd4c87e8-b4ef-471b-92cc-cf1ae3c742f7', '9fd2035d-cb6d-45ef-be03-ef211ca0683b', 'e43b24c2-f9a5-4750-90b4-a7d209026d46', 'f3201a74-0d66-4779-b759-db658d313d43'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "cinder-9e6c04ae-1a99-4181-a3bc-018570057e6a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-9e6c04ae-1a99-4181-a3bc-018570057e6a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:03 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:03 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[96437601-9d9a-4a87-8002-5023ca4fed33]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-852c3609-052d-4559-abd1-8b2003eb1b97-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "cinder-852c3609-052d-4559-abd1-8b2003eb1b97-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:03 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a Jul 07 22:40:03 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-852c3609-052d-4559-abd1-8b2003eb1b97" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-852c3609-052d-4559-abd1-8b2003eb1b97" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f431c-1055-4f71-a7b8-2c87298fce6d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:03 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 Jul 07 22:40:03 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Deleted volume successfully. Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a2de6605-35b8-4198-84bf-b66bc1cce959 tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-254d7249-e7fc-450c-aac2-3221ca47a590-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Flow 'volume_create_manager' (1437a025-3217-426a-a873-ab58dd63b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c7cf0-226f-42cc-a627-1627ba6d5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c7cf0-226f-42cc-a627-1627ba6d5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1881010215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866d612f-89ac-4ab1-a6e2-fdb5b038fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81571797613f4dbaa2bc98b77b37f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:04Z,use_quota=True,user_id='c8eef2906f60449796b049a289a97692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a81970-bedf-4dd8-a914-d9571ca2185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a81970-bedf-4dd8-a914-d9571ca2185f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5827af3e-e594-4fec-8c5e-a4270df85dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5827af3e-e594-4fec-8c5e-a4270df85dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '866d612f-89ac-4ab1-a6e2-fdb5b038fb00', 'volume_name': 'volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a158695-63d1-416c-a686-2b9bf9243e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a158695-63d1-416c-a686-2b9bf9243e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d4706b-2ecc-4569-8f9e-68ceb224ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Volume 866d612f-89ac-4ab1-a6e2-fdb5b038fb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00', 'volume_size': 1} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1881010215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866d612f-89ac-4ab1-a6e2-fdb5b038fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81571797613f4dbaa2bc98b77b37f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:04Z,use_quota=True,user_id='c8eef2906f60449796b049a289a97692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Creating volume 866d612f-89ac-4ab1-a6e2-fdb5b038fb00 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:04 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:04 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 1073741824 Jul 07 22:40:04 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a" returned: 0 in 1.100s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:04 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a Jul 07 22:40:04 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97" returned: 0 in 1.018s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:04 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97 Jul 07 22:40:04 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:05 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9e6c04ae-1a99-4181-a3bc-018570057e6a" returned: 0 in 0.752s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-quobyte-9e6c04ae-1a99-4181-a3bc-018570057e6a" released by "delete_volume" :: held 1.925s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Created reservations ['f73e83a2-678c-4876-8e3a-7329aec24cbd', 'efc2f31c-0cc2-4206-9154-1fcf49bed7f3', '88646f2a-9056-4c48-8d2b-9d2dffabb072', '32113eb2-2472-4d48-b5bc-7e4330567e2b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:05 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-852c3609-052d-4559-abd1-8b2003eb1b97" returned: 0 in 0.752s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:05 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:05 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-852c3609-052d-4559-abd1-8b2003eb1b97" released by "delete_volume" :: held 1.843s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Created reservations ['dfb4e2eb-c821-443e-aa4d-d26a9dd8b190', 'c8f45c88-24b2-4ad8-ad7d-1a2eb84e5565', '198e1ac6-3a9c-4b24-9800-499aea9215fa', 'c8cb3ff4-82f6-41f2-a4b2-13d3161d5bfa'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:05 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 1073741824" returned: 0 in 1.202s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:05 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:05 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:05 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 Jul 07 22:40:05 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-b9c5824b-7f03-45e4-895d-2b0ae391d1b3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "cinder-b9c5824b-7f03-45e4-895d-2b0ae391d1b3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Acquiring lock "cinder-quobyte-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[910acfec-0c13-4c65-85a8-f455e9ea164d]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:06 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.897s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Deleted volume successfully. Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8149d577-d64a-484d-87a3-a339be3dcb23 tempest-SnapshotsActionsTest-821113518 None] Lock "cinder-9e6c04ae-1a99-4181-a3bc-018570057e6a-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:06 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:40:06 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:06 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" returned: 0 in 1.022s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d4706b-2ecc-4569-8f9e-68ceb224ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65ceefb-21cb-4079-85c9-6d7dd9186776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Volume volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 (866d612f-89ac-4ab1-a6e2-fdb5b038fb00): created successfully Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65ceefb-21cb-4079-85c9-6d7dd9186776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Flow 'volume_create_manager' (1437a025-3217-426a-a873-ab58dd63b755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-22128c24-3736-418a-8f17-d06e70bd5cbf tempest-VolumesTransfersV357Test-735479814 None] Created volume successfully. Jul 07 22:40:06 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.139s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:06 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:40:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-75d75a94-bfc7-4827-8a32-d8bde61eb2cb tempest-VolumesGetTest-57541229 None] Lock "cinder-852c3609-052d-4559-abd1-8b2003eb1b97-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:07 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 0 in 0.974s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:07 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:40:07 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-ce62fd08-668b-42b0-ae64-11f23b3aecb0 req-acce8a59-fa61-46b2-a797-8499cc090ee3 tempest-AttachVolumeNegativeTest-1968883960 None] Terminate volume connection completed successfully. Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-ce62fd08-668b-42b0-ae64-11f23b3aecb0 req-acce8a59-fa61-46b2-a797-8499cc090ee3 tempest-AttachVolumeNegativeTest-1968883960 None] Deleting attachment d0a0cb3b-fbb6-4f00-845a-91712f229e52. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "cinder-866d612f-89ac-4ab1-a6e2-fdb5b038fb00-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-866d612f-89ac-4ab1-a6e2-fdb5b038fb00-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "cinder-quobyte-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-quobyte-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd10530-ff3e-4727-9067-fabb0ae41c84]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:08 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 Jul 07 22:40:08 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:08 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 1 in 1.337s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:08 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3 Jul 07 22:40:08 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:09 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:09 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" returned: 0 in 1.067s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "cinder-quobyte-b9c5824b-7f03-45e4-895d-2b0ae391d1b3" released by "delete_volume" :: held 3.196s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:09 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00 Jul 07 22:40:09 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Created reservations ['a99bde97-1765-47d9-9859-7b5477a72380', '5ea3cd25-0f1a-418c-bb0b-bc2751852e9f', 'da4e7987-5011-4ee5-ba0c-218adae0fa3a', '029421f3-cfbd-4560-8bd2-1bbe2722db37'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:09 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:09 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:10 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-quobyte-866d612f-89ac-4ab1-a6e2-fdb5b038fb00" released by "delete_volume" :: held 2.003s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Created reservations ['5c39df2a-e8ed-4aba-9a55-6cb49fe53447', '6b227835-cd46-4c88-88d3-d7f6ba9e5d6a', 'a811c301-3fde-498a-b2e4-25503700eb63', '17418c71-783e-4670-9c57-51758a118156'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:10 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Deleted volume successfully. Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-53f97308-e8b7-4694-ae6c-e88eee9e2496 tempest-VolumesGetTest-57541229 None] Lock "cinder-b9c5824b-7f03-45e4-895d-2b0ae391d1b3-delete_volume" released by "delete_volume" :: held 4.401s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:10 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:10 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:11 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.724s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:11 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Deleted volume successfully. Jul 07 22:40:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c8f2c9b0-f89c-4a76-b898-b5a119e9d86d tempest-VolumesTransfersV357Test-595158264 None] Lock "cinder-866d612f-89ac-4ab1-a6e2-fdb5b038fb00-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Flow 'volume_create_manager' (362869a2-364b-4dc1-85a5-78adfe6a61fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da74aea-2573-4a81-a788-fffc3ede999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da74aea-2573-4a81-a788-fffc3ede999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2140248689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc4a35d-7823-4948-ab9a-2cfef58885be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9951072c354ffcab07a940009e50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:14Z,use_quota=True,user_id='b940bd6129114503a49a86dd7326aff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e33f9c1-9cfb-49af-a594-f22ef5ae3020),volume_type_id=6e33f9c1-9cfb-49af-a594-f22ef5ae3020)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6733c2-daaa-4cac-9e8d-a7b407c13ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6733c2-daaa-4cac-9e8d-a7b407c13ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bf1dd4-bbf0-4051-8e86-e5c43db9ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bf1dd4-bbf0-4051-8e86-e5c43db9ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc4a35d-7823-4948-ab9a-2cfef58885be', 'volume_name': 'volume-7cc4a35d-7823-4948-ab9a-2cfef58885be', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e916b99-9fd4-46ba-a563-81d53cb4f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e916b99-9fd4-46ba-a563-81d53cb4f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c71c44-3fee-45b1-90b0-411f059c0a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:14 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Volume 7cc4a35d-7823-4948-ab9a-2cfef58885be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc4a35d-7823-4948-ab9a-2cfef58885be', 'volume_size': 1} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2140248689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc4a35d-7823-4948-ab9a-2cfef58885be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9951072c354ffcab07a940009e50b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:14Z,use_quota=True,user_id='b940bd6129114503a49a86dd7326aff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e33f9c1-9cfb-49af-a594-f22ef5ae3020),volume_type_id=6e33f9c1-9cfb-49af-a594-f22ef5ae3020)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Creating volume 7cc4a35d-7823-4948-ab9a-2cfef58885be {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:14 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:14 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be 1073741824 Jul 07 22:40:14 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:15 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be 1073741824" returned: 0 in 1.153s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:15 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be Jul 07 22:40:15 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:15 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:15 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Flow 'volume_create_manager' (bfd95518-7270-4625-ba0e-35b3595ab8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f761422-001e-4b05-87dc-d312db501749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f761422-001e-4b05-87dc-d312db501749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1314415325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae481d-9b8d-401d-8893-d222c1ba1a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65647503769a4069a226171ada43e1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:16Z,use_quota=True,user_id='821e4243d14a42e3a48b2d63df0b0406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfff1a7-0ebc-4465-817a-46bf5fe49041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfff1a7-0ebc-4465-817a-46bf5fe49041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419183ca-02e6-4caf-b50f-42274d500234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419183ca-02e6-4caf-b50f-42274d500234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fae481d-9b8d-401d-8893-d222c1ba1a29', 'volume_name': 'volume-9fae481d-9b8d-401d-8893-d222c1ba1a29', 'volume_size': 2}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250749c2-9d6e-4c26-b3c2-2f9cd2aad123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250749c2-9d6e-4c26-b3c2-2f9cd2aad123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acc0145-9b54-40ad-915d-91aa02352f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Volume 9fae481d-9b8d-401d-8893-d222c1ba1a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fae481d-9b8d-401d-8893-d222c1ba1a29', 'volume_size': 2} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:16 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be" returned: 0 in 1.092s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1314415325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae481d-9b8d-401d-8893-d222c1ba1a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65647503769a4069a226171ada43e1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:16Z,use_quota=True,user_id='821e4243d14a42e3a48b2d63df0b0406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Creating volume 9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:16 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 2147483648 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:16 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 2147483648 Jul 07 22:40:16 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c71c44-3fee-45b1-90b0-411f059c0a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc4a35d-7823-4948-ab9a-2cfef58885be', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a85dd17-0717-465f-b793-3c87a57009bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Volume volume-7cc4a35d-7823-4948-ab9a-2cfef58885be (7cc4a35d-7823-4948-ab9a-2cfef58885be): created successfully Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a85dd17-0717-465f-b793-3c87a57009bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Flow 'volume_create_manager' (362869a2-364b-4dc1-85a5-78adfe6a61fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6c643189-ef33-4afa-b520-1ffef9ecbafc tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Created volume successfully. Jul 07 22:40:16 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.073s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:40:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:17 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 2147483648" returned: 0 in 1.205s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:17 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:17 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:17 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 Jul 07 22:40:17 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:18 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.781s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-03f262a7-fec8-431a-909f-65f22c15ff1a tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Retype volume completed successfully. Jul 07 22:40:18 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acc0145-9b54-40ad-915d-91aa02352f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fae481d-9b8d-401d-8893-d222c1ba1a29', 'volume_size': 2}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5f3aa6-8dce-44a8-b872-d315bda53ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:18 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Volume volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 (9fae481d-9b8d-401d-8893-d222c1ba1a29): created successfully Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5f3aa6-8dce-44a8-b872-d315bda53ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Flow 'volume_create_manager' (bfd95518-7270-4625-ba0e-35b3595ab8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ab3cd4a1-0db9-4732-a7e8-45f9ac808ae8 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Created volume successfully. Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "cinder-7cc4a35d-7823-4948-ab9a-2cfef58885be-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "cinder-7cc4a35d-7823-4948-ab9a-2cfef58885be-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "cinder-quobyte-7cc4a35d-7823-4948-ab9a-2cfef58885be" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "cinder-quobyte-7cc4a35d-7823-4948-ab9a-2cfef58885be" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ce510-75f6-48c8-870d-54ca8e3c21e2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:19 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be Jul 07 22:40:19 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Creating offline snapshot e2669c93-ac30-458a-a26d-0abb2b7475f6 of volume 9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba8c3c6-477f-41af-a411-1b9c609ce797]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 Jul 07 22:40:20 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be" returned: 0 in 1.117s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be Jul 07 22:40:20 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29" returned: 0 in 1.147s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 2G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 2G Jul 07 22:40:20 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7cc4a35d-7823-4948-ab9a-2cfef58885be" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "cinder-quobyte-7cc4a35d-7823-4948-ab9a-2cfef58885be" released by "delete_volume" :: held 2.049s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:21 devstack cinder-volume[88087]: WARNING cinder.quota [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:40:21 devstack cinder-volume[88087]: WARNING cinder.quota [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Created reservations ['0bf50b19-1c05-4a6d-8d32-0de72da6c462', '4ac5fc29-ab27-4f72-b21a-e765fd046744', 'c3ed944b-758f-459f-86f5-e8877a73496a', 'a8c49da5-de09-46c0-aa88-f58a3cef55ba'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:21 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:21 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:22 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.972s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Deleted volume successfully. Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13379175-4b8f-49bb-b0fb-9a2a47680389 tempest-VolumeRetypeWithoutMigrationTest-600251465 None] Lock "cinder-7cc4a35d-7823-4948-ab9a-2cfef58885be-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:22 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 2G" returned: 0 in 1.415s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:22 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 Jul 07 22:40:22 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (6e15b6bb-07c6-4045-8843-bcb26940194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8bcbd4-b7b3-4f93-947d-f34b15fefbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8bcbd4-b7b3-4f93-947d-f34b15fefbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2036862586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417e9891-f26d-49db-b017-920e33ff0ad7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:23Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860961fb-fc8e-48f5-82b7-41efc38474b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860961fb-fc8e-48f5-82b7-41efc38474b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d262ca51-d0f9-4881-95e8-0ba3b3929085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d262ca51-d0f9-4881-95e8-0ba3b3929085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '417e9891-f26d-49db-b017-920e33ff0ad7', 'volume_name': 'volume-417e9891-f26d-49db-b017-920e33ff0ad7', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1681499-cef2-4570-94f7-d0e849ee185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1681499-cef2-4570-94f7-d0e849ee185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f46017-bfac-4961-b83f-b06329c4bfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Volume 417e9891-f26d-49db-b017-920e33ff0ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-417e9891-f26d-49db-b017-920e33ff0ad7', 'volume_size': 1} Jul 07 22:40:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:23 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6" returned: 0 in 0.851s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:23 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 is being set with open permissions: ugo+rw Jul 07 22:40:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:23 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 Jul 07 22:40:23 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:24 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6" returned: 0 in 0.826s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info Jul 07 22:40:24 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:24 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info" returned: 0 in 0.764s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:24 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info is being set with open permissions: ugo+rw Jul 07 22:40:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info Jul 07 22:40:24 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.info" returned: 0 in 0.713s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.866s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2036862586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417e9891-f26d-49db-b017-920e33ff0ad7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:23Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Creating volume 417e9891-f26d-49db-b017-920e33ff0ad7 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:25 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:25 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 1073741824 Jul 07 22:40:25 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1cea2ade-d1ab-41e9-8306-03b9d94d1f88 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Create snapshot completed successfully Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "cinder-e2669c93-ac30-458a-a26d-0abb2b7475f6-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-e2669c93-ac30-458a-a26d-0abb2b7475f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "cinder-quobyte-e2669c93-ac30-458a-a26d-0abb2b7475f6" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-e2669c93-ac30-458a-a26d-0abb2b7475f6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Deleting offline snapshot e2669c93-ac30-458a-a26d-0abb2b7475f6 of volume 9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] snapshot_file for this snap is: volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee1935c-eb85-4072-909b-eeb291f4db32]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:26 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 Jul 07 22:40:26 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:26 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 1073741824" returned: 0 in 1.025s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:26 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 Jul 07 22:40:26 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:27 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6" returned: 0 in 0.919s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fae481d-9b8d-401d-8893-d222c1ba1a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b53aa9f-9be4-4b7a-9f22-47f3b2d7a74e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:27 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7" returned: 0 in 0.739s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:27 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 Jul 07 22:40:27 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f46017-bfac-4961-b83f-b06329c4bfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-417e9891-f26d-49db-b017-920e33ff0ad7', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbacd82d-b710-4fb2-82c3-97504c71b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Volume volume-417e9891-f26d-49db-b017-920e33ff0ad7 (417e9891-f26d-49db-b017-920e33ff0ad7): created successfully Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbacd82d-b710-4fb2-82c3-97504c71b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (6e15b6bb-07c6-4045-8843-bcb26940194d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-81167355-521e-4e6a-a1b7-6d4cc83f55cc tempest-VolumesListTestJSON-513595052 None] Created volume successfully. Jul 07 22:40:28 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29" returned: 0 in 0.925s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:28 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 Jul 07 22:40:28 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=155,cinder:SELECT=125,cinder:INSERT=41,cinder:DELETE=12 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (f4de0155-2e28-4958-aebc-6cd042accc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcac8ce-f87d-4a48-b2ce-1e4ccb170ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcac8ce-f87d-4a48-b2ce-1e4ccb170ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-350326111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1490c813-ff39-4207-99c4-323bdb82ab05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:29Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2332d16-931c-470a-83ab-d7e1a701f219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2332d16-931c-470a-83ab-d7e1a701f219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e2b11-6f3e-4686-921d-33c1c674e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e2b11-6f3e-4686-921d-33c1c674e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1490c813-ff39-4207-99c4-323bdb82ab05', 'volume_name': 'volume-1490c813-ff39-4207-99c4-323bdb82ab05', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741430f7-120b-4a1b-98ca-f6bc2f99268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741430f7-120b-4a1b-98ca-f6bc2f99268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d56bf42-82a2-4964-baa0-ffc67a6d8804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Volume 1490c813-ff39-4207-99c4-323bdb82ab05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1490c813-ff39-4207-99c4-323bdb82ab05', 'volume_size': 1} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-350326111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1490c813-ff39-4207-99c4-323bdb82ab05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:29Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Creating volume 1490c813-ff39-4207-99c4-323bdb82ab05 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:28 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:28 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 1073741824 Jul 07 22:40:28 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:29 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6" returned: 0 in 1.122s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:29 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6 Jul 07 22:40:29 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:30 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 1073741824" returned: 0 in 1.225s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:30 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 Jul 07 22:40:30 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:30 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29.e2669c93-ac30-458a-a26d-0abb2b7475f6" returned: 0 in 0.984s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-e2669c93-ac30-458a-a26d-0abb2b7475f6" released by "_delete_snapshot" :: held 4.109s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" released by "delete_snapshot" :: held 4.142s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Created reservations ['e450f0e6-52a5-4b34-a601-3c923ab0fe9e', '3224bc98-0554-4cdd-8d60-8cdc542d28cf', '51db01bf-1500-4bb1-af51-f38ac6dce785', '6fe7efd6-7f8b-4b39-bb62-5bdee56c2456'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Delete snapshot completed successfully. Jul 07 22:40:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3bd494d8-e100-4b2c-964b-1a6212ebbf58 tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-e2669c93-ac30-458a-a26d-0abb2b7475f6-delete_snapshot" released by "delete_snapshot" :: held 4.419s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:31 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d56bf42-82a2-4964-baa0-ffc67a6d8804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1490c813-ff39-4207-99c4-323bdb82ab05', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9089be-9a95-41b3-8433-d75c249a10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:31 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Volume volume-1490c813-ff39-4207-99c4-323bdb82ab05 (1490c813-ff39-4207-99c4-323bdb82ab05): created successfully Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9089be-9a95-41b3-8433-d75c249a10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (f4de0155-2e28-4958-aebc-6cd042accc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-38301719-f6bc-4c35-84e2-8b386552fddd tempest-VolumesListTestJSON-513595052 None] Created volume successfully. Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "cinder-9fae481d-9b8d-401d-8893-d222c1ba1a29-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-9fae481d-9b8d-401d-8893-d222c1ba1a29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbcffc9-15a4-456e-b4f6-e891e1b95209]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:31 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 Jul 07 22:40:31 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (73440ce0-a8dc-4ab3-adde-6c0a6ef1a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:32 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409afb3b-7393-49f9-9672-cb925d099c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29" returned: 0 in 1.003s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409afb3b-7393-49f9-9672-cb925d099c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1278165183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb255c2-0119-48a3-b667-4c99c4ed731a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:33Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29 Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44d006a-a165-4c13-934b-feee2d5c1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44d006a-a165-4c13-934b-feee2d5c1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3ea7af-d569-48ed-82fb-3dec4e0f781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3ea7af-d569-48ed-82fb-3dec4e0f781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb255c2-0119-48a3-b667-4c99c4ed731a', 'volume_name': 'volume-2bb255c2-0119-48a3-b667-4c99c4ed731a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd1de21-0799-4f28-96ae-91aa402c6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd1de21-0799-4f28-96ae-91aa402c6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ed3bb-d2e8-443c-9d17-41dd2548421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Volume 2bb255c2-0119-48a3-b667-4c99c4ed731a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb255c2-0119-48a3-b667-4c99c4ed731a', 'volume_size': 1} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1278165183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb255c2-0119-48a3-b667-4c99c4ed731a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12e1a9fc47e1482490c49583bd1e199f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:33Z,use_quota=True,user_id='8d60543f5436456d9f43b2454ae9f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Creating volume 2bb255c2-0119-48a3-b667-4c99c4ed731a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:32 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:40:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:32 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a 1073741824 Jul 07 22:40:32 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:33 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9fae481d-9b8d-401d-8893-d222c1ba1a29" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-quobyte-9fae481d-9b8d-401d-8893-d222c1ba1a29" released by "delete_volume" :: held 1.786s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Created reservations ['4626e418-d631-438d-a742-1e8e26a8904f', 'e184cc1a-bf85-446c-8cef-c439e0b037c1', 'c0f54690-cf4b-48dc-8405-0b0bcc86371c', '5605445e-d94c-4985-a58d-8feae36ae328'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:33 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:33 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:33 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a 1073741824" returned: 0 in 0.972s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:33 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a Jul 07 22:40:33 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:34 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.906s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Deleted volume successfully. Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-138f0d5a-e6ec-4b18-afdd-fe6489607c0a tempest-VolumesSnapshotNegativeTestJSON-1033325336 None] Lock "cinder-9fae481d-9b8d-401d-8893-d222c1ba1a29-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:34 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a" returned: 0 in 0.952s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ed3bb-d2e8-443c-9d17-41dd2548421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb255c2-0119-48a3-b667-4c99c4ed731a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2328256-0447-41ba-b9fc-1d6af70b8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Volume volume-2bb255c2-0119-48a3-b667-4c99c4ed731a (2bb255c2-0119-48a3-b667-4c99c4ed731a): created successfully Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2328256-0447-41ba-b9fc-1d6af70b8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Flow 'volume_create_manager' (73440ce0-a8dc-4ab3-adde-6c0a6ef1a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ce6702f2-de90-4b72-ad11-7ce6f47c7e13 tempest-VolumesListTestJSON-513595052 None] Created volume successfully. Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-2bb255c2-0119-48a3-b667-4c99c4ed731a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "cinder-2bb255c2-0119-48a3-b667-4c99c4ed731a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=170,cinder:SELECT=144,cinder:INSERT=49,cinder:DELETE=15 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-quobyte-2bb255c2-0119-48a3-b667-4c99c4ed731a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-2bb255c2-0119-48a3-b667-4c99c4ed731a" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360173a-d7cf-4fad-8584-18d8cd41e28d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:39 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a Jul 07 22:40:39 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:40 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a" returned: 0 in 1.430s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:40 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a Jul 07 22:40:40 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:41 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2bb255c2-0119-48a3-b667-4c99c4ed731a" returned: 0 in 1.075s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-2bb255c2-0119-48a3-b667-4c99c4ed731a" released by "delete_volume" :: held 2.594s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:41 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Created reservations ['dada7f5c-0a83-4b52-8a4d-88d2438225ed', '2bc14453-a51b-4705-82f2-432b2fda0881', 'bbad0261-8047-476d-a299-4c6b43f02a35', '82c33e58-8e17-4c71-9dfd-a7dd8e829e81'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:42 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:42 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-1490c813-ff39-4207-99c4-323bdb82ab05-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-1490c813-ff39-4207-99c4-323bdb82ab05-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-quobyte-1490c813-ff39-4207-99c4-323bdb82ab05" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-1490c813-ff39-4207-99c4-323bdb82ab05" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae475d-e8bf-43ed-bfef-3939ffbd0fbe]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:43 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.104s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Deleted volume successfully. Jul 07 22:40:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d8d99933-a375-4d60-a56c-3973b81b163f tempest-VolumesListTestJSON-513595052 None] Lock "cinder-2bb255c2-0119-48a3-b667-4c99c4ed731a-delete_volume" released by "delete_volume" :: held 4.096s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:43 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 Jul 07 22:40:43 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:44 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05" returned: 0 in 1.121s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:44 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05 Jul 07 22:40:44 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:45 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1490c813-ff39-4207-99c4-323bdb82ab05" returned: 0 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-1490c813-ff39-4207-99c4-323bdb82ab05" released by "delete_volume" :: held 2.196s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Created reservations ['5ba9bf6c-2afb-4abc-b6a8-f977922c67d1', 'ca129268-a31a-482d-ab7e-d7a801940778', 'bc1e065a-8ac0-46f6-bdc5-d8f98aced4b0', '82e4cb1d-4ab7-4641-b13e-402bd3575984'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:45 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:45 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-417e9891-f26d-49db-b017-920e33ff0ad7-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-417e9891-f26d-49db-b017-920e33ff0ad7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "cinder-quobyte-417e9891-f26d-49db-b017-920e33ff0ad7" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-417e9891-f26d-49db-b017-920e33ff0ad7" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:46 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.205s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Deleted volume successfully. Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd0aea-71c3-47c0-8648-310b33c00a52]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49b3717f-ab78-492a-9a41-2648c0d91819 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-1490c813-ff39-4207-99c4-323bdb82ab05-delete_volume" released by "delete_volume" :: held 3.951s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:46 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 Jul 07 22:40:46 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:47 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7" returned: 0 in 1.156s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:47 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7 Jul 07 22:40:47 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:49 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-417e9891-f26d-49db-b017-920e33ff0ad7" returned: 0 in 1.162s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-quobyte-417e9891-f26d-49db-b017-920e33ff0ad7" released by "delete_volume" :: held 2.409s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Created reservations ['21a745ed-26a8-4d35-abe0-c9c54a3c545b', '2cd42627-a274-44e2-a43f-f20895291b5c', '892ff1c3-0c2b-4faf-99b4-200d72b31875', 'd8bc1550-d4a7-46db-a22e-90ac3c03cd99'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:49 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:40:49 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:50 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.203s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:50 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Deleted volume successfully. Jul 07 22:40:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a22e5554-0632-4df7-ae68-59789a15bce1 tempest-VolumesListTestJSON-513595052 None] Lock "cinder-417e9891-f26d-49db-b017-920e33ff0ad7-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:59 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=29,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:41:00 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:41:06 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (b3a59d9a-4bf9-47a9-bd1f-bdccc2a808f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7175d32f-24b1-40a0-b508-3552c41ed360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7175d32f-24b1-40a0-b508-3552c41ed360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1007436969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750d2598-45c2-4dcd-885b-e8e3a9212322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:07Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4d0aac-7ea6-4828-a4b6-8a9d46e7f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4d0aac-7ea6-4828-a4b6-8a9d46e7f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d75bda-201b-4cee-a91e-4e26608ed035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d75bda-201b-4cee-a91e-4e26608ed035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750d2598-45c2-4dcd-885b-e8e3a9212322', 'volume_name': 'volume-750d2598-45c2-4dcd-885b-e8e3a9212322', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b70553-b528-4410-bc42-42b8946098f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b70553-b528-4410-bc42-42b8946098f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44af2ca0-c081-4525-ab30-1090788eb247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:07 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Volume 750d2598-45c2-4dcd-885b-e8e3a9212322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750d2598-45c2-4dcd-885b-e8e3a9212322', 'volume_size': 1} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1007436969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750d2598-45c2-4dcd-885b-e8e3a9212322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b7f8441b2c41039338f768073ef2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:07Z,use_quota=True,user_id='ca0fae1c6acf4ff9af0e7bdc4552052b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Creating volume 750d2598-45c2-4dcd-885b-e8e3a9212322 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:07 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:07 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 1073741824 Jul 07 22:41:07 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:08 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 1073741824" returned: 0 in 1.386s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:08 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 Jul 07 22:41:08 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:10 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322" returned: 0 in 1.457s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] <== create_volume: return (2928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.931s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44af2ca0-c081-4525-ab30-1090788eb247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750d2598-45c2-4dcd-885b-e8e3a9212322', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5de8b2c-d2c1-43bd-98d1-5a2160907ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:10 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Volume volume-750d2598-45c2-4dcd-885b-e8e3a9212322 (750d2598-45c2-4dcd-885b-e8e3a9212322): created successfully Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5de8b2c-d2c1-43bd-98d1-5a2160907ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Flow 'volume_create_manager' (b3a59d9a-4bf9-47a9-bd1f-bdccc2a808f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-665e7ece-f6e1-4297-8890-99d68224b343 tempest-AttachVolumeNegativeTest-1968883960 None] Created volume successfully. Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (dd13497b-253f-45d6-9a87-6346785ff920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c633d0e9-25bf-4ce3-a2e6-d6ebda2a8f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c633d0e9-25bf-4ce3-a2e6-d6ebda2a8f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1997648154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87d294a-f7b9-413f-90b9-78d907c13175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:13Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a10d84-9d66-4505-a2c3-9c9d74ded82a),volume_type_id=d3a10d84-9d66-4505-a2c3-9c9d74ded82a)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caed9c8b-5f01-4552-81c2-f88b68a82c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caed9c8b-5f01-4552-81c2-f88b68a82c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8d4fe-0244-4cfd-b2e8-7bc54edc4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8d4fe-0244-4cfd-b2e8-7bc54edc4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87d294a-f7b9-413f-90b9-78d907c13175', 'volume_name': 'volume-c87d294a-f7b9-413f-90b9-78d907c13175', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd9f48e-fb52-4247-9650-48c97e612ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd9f48e-fb52-4247-9650-48c97e612ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0e14e0-b623-433b-8803-9fa99971033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume c87d294a-f7b9-413f-90b9-78d907c13175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87d294a-f7b9-413f-90b9-78d907c13175', 'volume_size': 1} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1997648154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87d294a-f7b9-413f-90b9-78d907c13175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:13Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a10d84-9d66-4505-a2c3-9c9d74ded82a),volume_type_id=d3a10d84-9d66-4505-a2c3-9c9d74ded82a)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Creating volume c87d294a-f7b9-413f-90b9-78d907c13175 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:12 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:12 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 1073741824 Jul 07 22:41:12 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (65c0efde-93e5-4492-852d-3b3aadcd04ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54c7f0-bd71-411a-aa88-aee7fcf9c20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54c7f0-bd71-411a-aa88-aee7fcf9c20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033743213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:13Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(096e8892-0b4a-44d8-a7f5-87c831fe43db),volume_type_id=096e8892-0b4a-44d8-a7f5-87c831fe43db)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d57afcf-46fd-4041-99af-0ea89f938298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d57afcf-46fd-4041-99af-0ea89f938298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a993875-ef6f-44bc-bab4-9c0d3b5fc033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a993875-ef6f-44bc-bab4-9c0d3b5fc033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a', 'volume_name': 'volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ca138-f99e-451c-b53d-db4a5b4377f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ca138-f99e-451c-b53d-db4a5b4377f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0449ce-10b9-4d88-b751-6bb3728a9a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a', 'volume_size': 1} Jul 07 22:41:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:14 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 1073741824" returned: 0 in 1.579s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:14 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 Jul 07 22:41:14 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (6c6eb69e-7e7a-48dd-bea4-b2d525c44d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d935e6-632e-4649-bb43-2325207910c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d935e6-632e-4649-bb43-2325207910c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-452395476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a6cc76-9823-4852-9298-98ad34fe7da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:15Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cec7f04c-7ed9-4bbc-9743-bb379f4f22b8),volume_type_id=cec7f04c-7ed9-4bbc-9743-bb379f4f22b8)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2543d4-406d-4b50-bfec-959f712cc447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2543d4-406d-4b50-bfec-959f712cc447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7018680b-6ea0-4453-8c7f-546a1b68966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:41:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7018680b-6ea0-4453-8c7f-546a1b68966c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53a6cc76-9823-4852-9298-98ad34fe7da5', 'volume_name': 'volume-53a6cc76-9823-4852-9298-98ad34fe7da5', 'volume_size': 1, 'image_id': '35fda681-762b-4e87-8a61-87400c14eec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--890074242', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7948896c71804a6098ed1ba1729f5a1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35fda681-762b-4e87-8a61-87400c14eec4', 'created_at': datetime.datetime(2026, 7, 7, 20, 41, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 41, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35fda681-762b-4e87-8a61-87400c14eec4/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30baad92-379b-4f57-a19a-de5e6210fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30baad92-379b-4f57-a19a-de5e6210fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467ab43c-9761-46a4-802e-c7ed67255322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume 53a6cc76-9823-4852-9298-98ad34fe7da5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53a6cc76-9823-4852-9298-98ad34fe7da5', 'volume_size': 1, 'image_id': '35fda681-762b-4e87-8a61-87400c14eec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--890074242', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7948896c71804a6098ed1ba1729f5a1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35fda681-762b-4e87-8a61-87400c14eec4', 'created_at': datetime.datetime(2026, 7, 7, 20, 41, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 41, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35fda681-762b-4e87-8a61-87400c14eec4/file', 'properties': {}}, 'image_service': } Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Trying to clone 53a6cc76-9823-4852-9298-98ad34fe7da5 from image 35fda681-762b-4e87-8a61-87400c14eec4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.614s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033743213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:13Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(096e8892-0b4a-44d8-a7f5-87c831fe43db),volume_type_id=096e8892-0b4a-44d8-a7f5-87c831fe43db)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Creating volume a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:15 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:15 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a 1073741824 Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0e14e0-b623-433b-8803-9fa99971033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87d294a-f7b9-413f-90b9-78d907c13175', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ccbf88-698b-4f15-815e-6b2f2bb9d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume volume-c87d294a-f7b9-413f-90b9-78d907c13175 (c87d294a-f7b9-413f-90b9-78d907c13175): created successfully Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ccbf88-698b-4f15-815e-6b2f2bb9d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (dd13497b-253f-45d6-9a87-6346785ff920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6eacc0f9-1efd-400f-b374-041aea5c8cbe tempest-TestInstancesWithCinderVolumes-1303876687 None] Created volume successfully. Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:15 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:41:15 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:16 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.235s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:41:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:41:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:41:17 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a 1073741824" returned: 0 in 1.801s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:17 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a Jul 07 22:41:17 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:18 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" returned: 0 in 0.961s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] <== create_volume: return (2826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.829s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.299s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0449ce-10b9-4d88-b751-6bb3728a9a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee3e0c-7a5e-4824-9a31-a77ffb5b0916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac334b0-d8d4-436e-aeb2-baa02aad34c7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:18 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a (a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a): created successfully Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee3e0c-7a5e-4824-9a31-a77ffb5b0916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (65c0efde-93e5-4492-852d-3b3aadcd04ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ce7466c3-5f55-4140-9e4a-651043521af5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Created volume successfully. Jul 07 22:41:18 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 Jul 07 22:41:18 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:19 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322" returned: 0 in 1.038s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.078s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-750d2598-45c2-4dcd-885b-e8e3a9212322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f07a91b-df7f-40de-bdaa-59aff54c7683', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:41:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b57b5a48-3f1d-4988-a120-11265ea6813c req-ccf5f556-bccd-4b4f-a598-73f44c894c2f tempest-AttachVolumeNegativeTest-1968883960 None] attachment_update completed successfully. Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (5ab3e452-5f04-4ac3-95d6-37268d1e6d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524a4ec8-f7a2-493e-a823-5c76f5674e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524a4ec8-f7a2-493e-a823-5c76f5674e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438066185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dc3956-42a5-4a6b-b4c5-54f7a205fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:20Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ee6b67-ff68-47ad-9414-668b6b5c9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ee6b67-ff68-47ad-9414-668b6b5c9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2662d09-cdcb-4854-9ff1-3cc19255a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2662d09-cdcb-4854-9ff1-3cc19255a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8dc3956-42a5-4a6b-b4c5-54f7a205fe42', 'volume_name': 'volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac86cfb5-31c5-42f9-9967-fbe2e5450e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac86cfb5-31c5-42f9-9967-fbe2e5450e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58a5974-633b-4373-8ec7-83fb04ba3038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume d8dc3956-42a5-4a6b-b4c5-54f7a205fe42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42', 'volume_size': 1} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438066185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dc3956-42a5-4a6b-b4c5-54f7a205fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:20Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Creating volume d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:19 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:19 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 1073741824 Jul 07 22:41:19 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:20 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD, size 20.69 MB, duration 5.03 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:41:20 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Image download 20.69 MB at 4.11 MB/s Jul 07 22:41:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e19418-32b9-4463-9ca7-28b9a3c1fe7b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:20 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD Jul 07 22:41:20 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:21 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 1073741824" returned: 0 in 1.371s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:21 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 Jul 07 22:41:21 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:21 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD" returned: 0 in 0.959s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Temporary image 35fda681-762b-4e87-8a61-87400c14eec4 is fetched for user 000e0239ea4644d9a36af4ba4b93610b. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[de446db8-4ee7-409d-a032-72d3c5c29850]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:21 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD Jul 07 22:41:21 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:22 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.376s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58a5974-633b-4373-8ec7-83fb04ba3038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f588d3-db57-4300-895a-375665d00439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:22 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 (d8dc3956-42a5-4a6b-b4c5-54f7a205fe42): created successfully Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f588d3-db57-4300-895a-375665d00439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (5ab3e452-5f04-4ac3-95d6-37268d1e6d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fd464955-ff17-4b47-9241-3f946a20da6e tempest-VolumesSnapshotTestJSON-1437457769 None] Created volume successfully. Jul 07 22:41:22 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD" returned: 0 in 0.995s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-452395476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a6cc76-9823-4852-9298-98ad34fe7da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948896c71804a6098ed1ba1729f5a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:15Z,use_quota=True,user_id='000e0239ea4644d9a36af4ba4b93610b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cec7f04c-7ed9-4bbc-9743-bb379f4f22b8),volume_type_id=cec7f04c-7ed9-4bbc-9743-bb379f4f22b8)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Creating volume 53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:22 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:22 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1073741824 Jul 07 22:41:22 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:23 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1073741824" returned: 0 in 1.099s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:26 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:26 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:27 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 0.684s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] <== create_volume: return (4957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.964s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Attempting download of 35fda681-762b-4e87-8a61-87400c14eec4 ((None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}])) to volume 53a6cc76-9823-4852-9298-98ad34fe7da5. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a30bd6-e460-48e8-a7ae-6847f8d4efa7]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:27 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c Jul 07 22:41:27 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Creating offline snapshot 6d90b465-1773-4d96-91e5-cc29885866e5 of volume d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:41:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a3ce0-acc3-4a41-a729-3974baa54fee]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:28 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 Jul 07 22:41:28 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:28 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c" returned: 0 in 1.041s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:28 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c Jul 07 22:41:28 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:29 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" returned: 0 in 1.156s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:29 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 1G Jul 07 22:41:29 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:29 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c" returned: 1 in 0.957s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35fda681-762b-4e87-8a61-87400c14eec4_g6nccx_c' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[20850dc7-ec49-41ae-8758-36d336d8ff92]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:29 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD Jul 07 22:41:29 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-df89dee5-324b-4271-ac4d-8980345524d1 req-13cc3b2e-8b8d-4a40-b3a8-d0598e01b302 tempest-AttachVolumeNegativeTest-1968883960 None] Terminate volume connection completed successfully. Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-df89dee5-324b-4271-ac4d-8980345524d1 req-13cc3b2e-8b8d-4a40-b3a8-d0598e01b302 tempest-AttachVolumeNegativeTest-1968883960 None] Deleting attachment 8f07a91b-df7f-40de-bdaa-59aff54c7683. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:41:30 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 1G" returned: 0 in 1.108s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:30 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 Jul 07 22:41:30 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:30 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] 35fda681-762b-4e87-8a61-87400c14eec4 was qcow2, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:41:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:30 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:30 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:31 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:31 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 is being set with open permissions: ugo+rw Jul 07 22:41:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:31 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 Jul 07 22:41:31 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:31 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5" returned: 0 in 0.727s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:31 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info Jul 07 22:41:31 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:32 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info is being set with open permissions: ugo+rw Jul 07 22:41:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:32 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info Jul 07 22:41:32 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:33 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 2.336s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35fda681-762b-4e87-8a61-87400c14eec4_fs0yhzhvdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:41:33 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Converted 112.00 MB image at 47.92 MB/s Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:33 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1G Jul 07 22:41:33 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:33 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.info" returned: 0 in 0.710s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.460s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-23cd19d4-7c7a-4a6e-bf29-7310e7cc00ef tempest-VolumesSnapshotTestJSON-1437457769 None] Create snapshot completed successfully Jul 07 22:41:33 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 1G" returned: 0 in 0.825s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd06b6e-d34e-42b0-aaf6-90c7dba88dc9]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:34 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:34 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-6d90b465-1773-4d96-91e5-cc29885866e5-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-6d90b465-1773-4d96-91e5-cc29885866e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-6d90b465-1773-4d96-91e5-cc29885866e5" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-6d90b465-1773-4d96-91e5-cc29885866e5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleting offline snapshot 6d90b465-1773-4d96-91e5-cc29885866e5 of volume d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] snapshot_file for this snap is: volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba74c9bf-e6c5-44e9-ab34-96217f0db675]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:35 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 Jul 07 22:41:35 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:35 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 1.383s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:35 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:35 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:36 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5" returned: 0 in 1.529s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b775ea-7ee2-484c-b2cc-28c0356cae92]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:36 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 1 in 1.514s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Downloaded image 35fda681-762b-4e87-8a61-87400c14eec4 ((None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}])) to volume 53a6cc76-9823-4852-9298-98ad34fe7da5 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:41:36 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 Jul 07 22:41:36 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Temporary image 35fda681-762b-4e87-8a61-87400c14eec4 for user 000e0239ea4644d9a36af4ba4b93610b is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Marking volume 53a6cc76-9823-4852-9298-98ad34fe7da5 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Copying metadata from image 35fda681-762b-4e87-8a61-87400c14eec4 to 53a6cc76-9823-4852-9298-98ad34fe7da5. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:41:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Creating volume glance metadata for volume 53a6cc76-9823-4852-9298-98ad34fe7da5 backed by image 35fda681-762b-4e87-8a61-87400c14eec4 with: {'image_id': '35fda681-762b-4e87-8a61-87400c14eec4', 'image_name': 'tempest-scenario-img--890074242', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467ab43c-9761-46a4-802e-c7ed67255322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a6cc76-9823-4852-9298-98ad34fe7da5', 'volume_size': 1, 'image_id': '35fda681-762b-4e87-8a61-87400c14eec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35fda681-762b-4e87-8a61-87400c14eec4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--890074242', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7948896c71804a6098ed1ba1729f5a1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35fda681-762b-4e87-8a61-87400c14eec4', 'created_at': datetime.datetime(2026, 7, 7, 20, 41, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 41, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35fda681-762b-4e87-8a61-87400c14eec4/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fbfe00-dd20-426b-9b5a-f865ca757c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Volume volume-53a6cc76-9823-4852-9298-98ad34fe7da5 (53a6cc76-9823-4852-9298-98ad34fe7da5): created successfully Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fbfe00-dd20-426b-9b5a-f865ca757c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Flow 'volume_create_manager' (6c6eb69e-7e7a-48dd-bea4-b2d525c44d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-55330b17-4be5-48cb-a5f1-81fc951e67af tempest-TestInstancesWithCinderVolumes-1303876687 None] Created volume successfully. Jul 07 22:41:37 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" returned: 0 in 1.342s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:37 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 Jul 07 22:41:37 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:38 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5" returned: 0 in 0.907s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:38 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5 Jul 07 22:41:38 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:39 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42.6d90b465-1773-4d96-91e5-cc29885866e5" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-6d90b465-1773-4d96-91e5-cc29885866e5" released by "_delete_snapshot" :: held 4.856s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" released by "delete_snapshot" :: held 4.890s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['9bf20614-2695-4921-80c4-3ffd6b89019f', '3063c01f-d8e9-4aba-aa2c-6887ed710f55', '5c19ab31-b3a8-4c97-9506-757a3a51bfac', '551e2a87-657c-49ba-a328-7bf4990333e5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Delete snapshot completed successfully. Jul 07 22:41:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f48e69d7-ac1b-41a3-9c51-e4e302a42607 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-6d90b465-1773-4d96-91e5-cc29885866e5-delete_snapshot" released by "delete_snapshot" :: held 5.192s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (f2e87a23-2a7b-4d54-aa5e-832ce68d73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf52e1-253e-4395-8d73-1f50c1a1aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf52e1-253e-4395-8d73-1f50c1a1aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311379177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276ec905-7d27-464c-b6d4-3a7ceafad10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:41Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add8839-fa9b-4ae8-8ed3-355c0d985701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add8839-fa9b-4ae8-8ed3-355c0d985701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92350879-1d9f-44b8-b460-2f78d0ef85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92350879-1d9f-44b8-b460-2f78d0ef85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276ec905-7d27-464c-b6d4-3a7ceafad10d', 'volume_name': 'volume-276ec905-7d27-464c-b6d4-3a7ceafad10d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331c78c4-0e01-47eb-88a7-9a7bad8d821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331c78c4-0e01-47eb-88a7-9a7bad8d821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2be0d64-8bd6-4170-af63-f48d8dc12a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume 276ec905-7d27-464c-b6d4-3a7ceafad10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276ec905-7d27-464c-b6d4-3a7ceafad10d', 'volume_size': 1} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311379177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276ec905-7d27-464c-b6d4-3a7ceafad10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:41Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Creating volume 276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:40 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:40 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d 1073741824 Jul 07 22:41:40 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:42 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d 1073741824" returned: 0 in 1.311s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:42 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:41:42 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-750d2598-45c2-4dcd-885b-e8e3a9212322-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-750d2598-45c2-4dcd-885b-e8e3a9212322-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-quobyte-750d2598-45c2-4dcd-885b-e8e3a9212322" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-750d2598-45c2-4dcd-885b-e8e3a9212322" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e12376-8020-44b6-bac4-7238a8154d33]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:42 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 Jul 07 22:41:42 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:43 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 0.878s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2be0d64-8bd6-4170-af63-f48d8dc12a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276ec905-7d27-464c-b6d4-3a7ceafad10d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3723a755-fce7-4f06-8ed2-2b01d303334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume volume-276ec905-7d27-464c-b6d4-3a7ceafad10d (276ec905-7d27-464c-b6d4-3a7ceafad10d): created successfully Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3723a755-fce7-4f06-8ed2-2b01d303334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (f2e87a23-2a7b-4d54-aa5e-832ce68d73aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-da054379-d197-40cc-816b-d29d4af02e65 tempest-VolumesSnapshotTestJSON-1437457769 None] Created volume successfully. Jul 07 22:41:43 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322" returned: 0 in 1.040s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:43 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322 Jul 07 22:41:43 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Creating offline snapshot 7f01168a-1ca3-4866-96bd-4b3b844bc19e of volume 276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c104c860-9101-4409-bd3e-06cf2d1b0cd6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:44 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:41:44 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:44 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-750d2598-45c2-4dcd-885b-e8e3a9212322" returned: 0 in 1.057s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-750d2598-45c2-4dcd-885b-e8e3a9212322" released by "delete_volume" :: held 2.202s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Created reservations ['d8adb3e7-1d63-4e87-b1db-85394b2f851e', 'c710638b-ea24-42fc-9341-3e2b4ffbac71', '5c03498f-bc1e-44c7-b853-39028b572c5c', 'c1b92b21-6132-4f25-ac6c-49df3ce5f4ae'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:44 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:41:44 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:45 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 1.064s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:45 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e 1G Jul 07 22:41:45 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:45 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.882s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:45 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Deleted volume successfully. Jul 07 22:41:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-df6d9648-be42-41d0-a91c-ec3079a80990 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-750d2598-45c2-4dcd-885b-e8e3a9212322-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-723f69fe-7dc0-4a41-ac71-bdbd5a36010f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-723f69fe-7dc0-4a41-ac71-bdbd5a36010f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-quobyte-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9949dcfc-bd91-4712-b36e-b059fd0a3514]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:46 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f Jul 07 22:41:46 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:46 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e 1G" returned: 0 in 1.360s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276ec905-7d27-464c-b6d4-3a7ceafad10d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:46 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276ec905-7d27-464c-b6d4-3a7ceafad10d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:41:46 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:47 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" returned: 0 in 1.275s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:47 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f Jul 07 22:41:47 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:48 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276ec905-7d27-464c-b6d4-3a7ceafad10d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 1.242s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:48 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e is being set with open permissions: ugo+rw Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:48 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:41:48 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:48 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" returned: 0 in 0.903s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-723f69fe-7dc0-4a41-ac71-bdbd5a36010f" released by "delete_volume" :: held 2.254s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Created reservations ['0d4729bf-c34b-4141-9833-8ba1691afa63', '01d7abba-f25d-4f04-bd05-1c93e00998e2', '10559d7a-7ecb-40fd-b976-e0da1346e247', '59e9842f-27ac-4429-a6fa-a75fc2819e59'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:48 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:41:48 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:48 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 0.921s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:49 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info Jul 07 22:41:49 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (4f55d559-21f8-4ecd-aba5-06ffb32884ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc250588-8146-4916-81db-9278e0c0980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc250588-8146-4916-81db-9278e0c0980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192708629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932452bc-8fae-46e3-8bd9-28ce4d10319a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:49Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e41311-8e5d-4583-b4c7-142c57ea380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e41311-8e5d-4583-b4c7-142c57ea380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2dd463-3e4e-4578-a693-e47864a16eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2dd463-3e4e-4578-a693-e47864a16eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932452bc-8fae-46e3-8bd9-28ce4d10319a', 'volume_name': 'volume-932452bc-8fae-46e3-8bd9-28ce4d10319a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4af45-e486-48d0-87f4-61627ea30981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4af45-e486-48d0-87f4-61627ea30981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c7cf9c-1105-4293-9676-3d294d090d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Volume 932452bc-8fae-46e3-8bd9-28ce4d10319a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932452bc-8fae-46e3-8bd9-28ce4d10319a', 'volume_size': 1} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-d6156b8a-2f74-4367-a8f8-79d18e080194-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-d6156b8a-2f74-4367-a8f8-79d18e080194-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "cinder-quobyte-d6156b8a-2f74-4367-a8f8-79d18e080194" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-d6156b8a-2f74-4367-a8f8-79d18e080194" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bf86d-c8fb-4c12-adaf-7104afae59f3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:49 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 Jul 07 22:41:49 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:50 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info" returned: 0 in 1.025s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:50 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info is being set with open permissions: ugo+rw Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:50 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info Jul 07 22:41:50 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:50 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.400s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Deleted volume successfully. Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a987f611-6714-43f2-ada5-283c5c050b67 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-723f69fe-7dc0-4a41-ac71-bdbd5a36010f-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:50 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194" returned: 0 in 1.128s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:50 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194 Jul 07 22:41:50 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:50 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.info" returned: 0 in 0.901s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.732s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.918s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-57e35df6-aec4-4d4e-a0cb-1d6c2e919e9b tempest-VolumesSnapshotTestJSON-1437457769 None] Create snapshot completed successfully Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2873b-01bb-4fa8-89da-786b05605e11]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:51 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:51 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:51 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d6156b8a-2f74-4367-a8f8-79d18e080194" returned: 0 in 0.964s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-quobyte-d6156b8a-2f74-4367-a8f8-79d18e080194" released by "delete_volume" :: held 2.178s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:51 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Created reservations ['8e27ecab-e0fc-42e5-8452-5c4401f154ea', '195ecf8b-2155-4e07-b7fc-eb02c4982962', 'c6e6ae19-f176-488d-8545-c0c047f34ccf', '3bbea20d-7cd3-4101-89ee-d5957bc99719'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:52 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:41:52 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (b7613187-d3ed-49fc-8987-a723863cbd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a913e9e4-e01f-451e-9cda-36299fc2ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a913e9e4-e01f-451e-9cda-36299fc2ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1574032319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e2e2bc-6df6-46c3-b8bb-d3f4a106021b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7f01168a-1ca3-4866-96bd-4b3b844bc19e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:52Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe0e0d2-479e-40a5-88c3-2aa820bdd4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe0e0d2-479e-40a5-88c3-2aa820bdd4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c7174e-6dde-47cc-b23c-9386d2f51b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c7174e-6dde-47cc-b23c-9386d2f51b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28e2e2bc-6df6-46c3-b8bb-d3f4a106021b', 'volume_name': 'volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b', 'volume_size': 2, 'snapshot_id': '7f01168a-1ca3-4866-96bd-4b3b844bc19e'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0f963e-d0f0-458a-9987-f60d806d2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0f963e-d0f0-458a-9987-f60d806d2122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25a93e-d235-4b44-80d2-c5d45ea0e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:52 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume 28e2e2bc-6df6-46c3-b8bb-d3f4a106021b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b', 'volume_size': 2, 'snapshot_id': '7f01168a-1ca3-4866-96bd-4b3b844bc19e'} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:52 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 1.530s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:52 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:41:52 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:53 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.310s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Deleted volume successfully. Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-24200cbe-38cd-41a6-bf99-c3fa94d66fa7 tempest-AttachVolumeNegativeTest-1968883960 None] Lock "cinder-d6156b8a-2f74-4367-a8f8-79d18e080194-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:53 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 1 in 1.256s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.842s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192708629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932452bc-8fae-46e3-8bd9-28ce4d10319a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:49Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Creating volume 932452bc-8fae-46e3-8bd9-28ce4d10319a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:53 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a 1073741824 Jul 07 22:41:53 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-53a6cc76-9823-4852-9298-98ad34fe7da5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6405cd1f-fe22-4c67-8154-d2d94acf8c43', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:41:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-0ed9b7ea-92c4-4805-956b-46dac9b123ca req-60b172ae-7e92-48da-b47e-66ee1c31f8f5 tempest-TestInstancesWithCinderVolumes-1303876687 None] attachment_update completed successfully. Jul 07 22:41:55 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a 1073741824" returned: 0 in 1.256s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:55 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a Jul 07 22:41:55 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:55 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a" returned: 0 in 0.798s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.411s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c7cf9c-1105-4293-9676-3d294d090d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932452bc-8fae-46e3-8bd9-28ce4d10319a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eed3cf1-dae1-40a2-921b-ec7648f26e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Creating volume 28e2e2bc-6df6-46c3-b8bb-d3f4a106021b from snapshot 7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Volume volume-932452bc-8fae-46e3-8bd9-28ce4d10319a (932452bc-8fae-46e3-8bd9-28ce4d10319a): created successfully Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eed3cf1-dae1-40a2-921b-ec7648f26e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (4f55d559-21f8-4ecd-aba5-06ffb32884ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] snapshot: 7f01168a-1ca3-4866-96bd-4b3b844bc19e, volume: 28e2e2bc-6df6-46c3-b8bb-d3f4a106021b, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b232778f-9b35-4fad-988b-fc60c1ea4611 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8100464-9e38-435c-af29-a5f6708eae93]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:56 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:41:56 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-145fdd94-4f7e-47d8-8cd9-2dc0521ad81f tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a" by "attach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-145fdd94-4f7e-47d8-8cd9-2dc0521ad81f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a" acquired by "attach_volume" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-145fdd94-4f7e-47d8-8cd9-2dc0521ad81f tempest-VolumesActionsTest-1173254917 None] Attaching volume 932452bc-8fae-46e3-8bd9-28ce4d10319a to instance ad36cb77-2511-495b-9b56-69dae1969258 at mountpoint /dev/vdb on host None. Jul 07 22:41:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-145fdd94-4f7e-47d8-8cd9-2dc0521ad81f tempest-VolumesActionsTest-1173254917 None] Attach volume completed successfully. Jul 07 22:41:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-145fdd94-4f7e-47d8-8cd9-2dc0521ad81f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a" released by "attach_volume" :: held 0.163s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:57 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 1.264s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276ec905-7d27-464c-b6d4-3a7ceafad10d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dcbce5-1e22-4a9f-9e82-dd05dd276e1a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:57 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:41:57 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Terminate volume connection completed successfully. Jul 07 22:41:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" by "detach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Detaching volume 932452bc-8fae-46e3-8bd9-28ce4d10319a from instance ad36cb77-2511-495b-9b56-69dae1969258. Jul 07 22:41:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Detach volume completed successfully. Jul 07 22:41:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5af5110-3b22-4c43-8cfc-74d856f1ff06 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" released by "detach_volume" :: held 0.255s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:59 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 1.543s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:59 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b Jul 07 22:41:59 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-25afcfcc-9f56-4873-8e60-743f1c1ef5b8 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" by "detach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-25afcfcc-9f56-4873-8e60-743f1c1ef5b8 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-25afcfcc-9f56-4873-8e60-743f1c1ef5b8 tempest-VolumesActionsTest-1173254917 None] Volume detach called, but volume not attached. Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-25afcfcc-9f56-4873-8e60-743f1c1ef5b8 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:59 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=66,cinder:SELECT=66,cinder:DELETE=6,cinder:INSERT=17 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:42:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-quobyte-932452bc-8fae-46e3-8bd9-28ce4d10319a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-quobyte-932452bc-8fae-46e3-8bd9-28ce4d10319a" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:00 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc73fc21-42ca-409f-a14a-cccc4b736c4e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:00 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a Jul 07 22:42:00 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:02 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a" returned: 0 in 2.242s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:02 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a Jul 07 22:42:02 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:05 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-932452bc-8fae-46e3-8bd9-28ce4d10319a" returned: 0 in 2.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-quobyte-932452bc-8fae-46e3-8bd9-28ce4d10319a" released by "delete_volume" :: held 5.246s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=86,cinder:INSERT=19,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Created reservations ['ab79a78e-e1b7-4118-8e91-c0be1bdc0c1c', '7b1734dc-0595-47c2-804e-6dfd817ff85b', '26b1911f-329a-4483-aeea-935e56c3065d', 'f39b433f-443e-4097-a37f-ea7e53f5eaad'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:05 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:05 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:08 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 2.676s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Deleted volume successfully. Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f18cd684-8571-4152-a0fb-5d034d16b00f tempest-VolumesActionsTest-1173254917 None] Lock "cinder-932452bc-8fae-46e3-8bd9-28ce4d10319a-delete_volume" released by "delete_volume" :: held 8.528s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:08 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" returned: 0 in 9.647s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e3b4bc-81de-4288-89ef-83565dc82f64]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:09 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:42:09 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:09 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-958b3c54-9ca5-4aaf-97df-7899ba187067 tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-1377851368: creating Jul 07 22:42:09 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-958b3c54-9ca5-4aaf-97df-7899ba187067 tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-1377851368: created successfully Jul 07 22:42:09 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-958b3c54-9ca5-4aaf-97df-7899ba187067 tempest-GroupSnapshotsTest-358805566 None] Create group completed successfully. Jul 07 22:42:10 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 1.992s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:10 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d, size 1024.00 MB, duration 9.65 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:42:10 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Converted 1024.00 MB image at 106.13 MB/s Jul 07 22:42:10 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b is being set with open permissions: ugo+rw Jul 07 22:42:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:10 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b Jul 07 22:42:10 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:11 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" returned: 0 in 1.031s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" released by "_copy_volume_from_snapshot" :: held 15.693s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" released by "_create_volume_from_snapshot" :: held 15.766s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.811s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25a93e-d235-4b44-80d2-c5d45ea0e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b', 'volume_size': 2, 'snapshot_id': '7f01168a-1ca3-4866-96bd-4b3b844bc19e'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2014ef12-823e-4de3-adfe-679dc08449da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:11 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b (28e2e2bc-6df6-46c3-b8bb-d3f4a106021b): created successfully Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2014ef12-823e-4de3-adfe-679dc08449da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (b7613187-d3ed-49fc-8987-a723863cbd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-27d7488c-6455-4af1-8099-9f29a9f24360 tempest-VolumesSnapshotTestJSON-1437457769 None] Created volume successfully. Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (64c7f505-88e5-4f72-ba03-5099195af3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe63418c-5074-4879-9b8a-8c62b79c18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe63418c-5074-4879-9b8a-8c62b79c18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1979549778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee4f82a3-1a16-4b15-bec4-5f50f8f4b574,host='devstack@QuobyteHD#QuobyteHD',id=ff8bb960-28a7-4e73-a47d-1303e013e068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:12Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64a90dd-9a74-41e0-87de-0031109b46f9),volume_type_id=f64a90dd-9a74-41e0-87de-0031109b46f9)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8af61-1873-4c1c-bbd2-8fd88a29b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8af61-1873-4c1c-bbd2-8fd88a29b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee214c5f-f395-4565-b3b0-b05175f7f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee214c5f-f395-4565-b3b0-b05175f7f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8bb960-28a7-4e73-a47d-1303e013e068', 'volume_name': 'volume-ff8bb960-28a7-4e73-a47d-1303e013e068', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032c8be9-a39e-4c20-ba52-609cbbccc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032c8be9-a39e-4c20-ba52-609cbbccc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ae8a5-3023-4e5e-b9e1-65f36b13b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Volume ff8bb960-28a7-4e73-a47d-1303e013e068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8bb960-28a7-4e73-a47d-1303e013e068', 'volume_size': 1} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee4f82a3-1a16-4b15-bec4-5f50f8f4b574,created_at=2026-07-07T20:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1979549778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee4f82a3-1a16-4b15-bec4-5f50f8f4b574,host='devstack@QuobyteHD#QuobyteHD',id=ff8bb960-28a7-4e73-a47d-1303e013e068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:12Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64a90dd-9a74-41e0-87de-0031109b46f9),volume_type_id=f64a90dd-9a74-41e0-87de-0031109b46f9)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Creating volume ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:12 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:12 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 1073741824 Jul 07 22:42:12 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b58aafa-65dc-4b97-a715-bed028ea9668]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:13 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b Jul 07 22:42:13 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:13 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 1073741824" returned: 0 in 1.283s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:13 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:13 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:14 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" returned: 0 in 1.160s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:14 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b Jul 07 22:42:14 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:14 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 1.144s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] <== create_volume: return (2503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ae8a5-3023-4e5e-b9e1-65f36b13b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8bb960-28a7-4e73-a47d-1303e013e068', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1804bf56-4206-4a20-953b-7a48a66fccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:14 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Volume volume-ff8bb960-28a7-4e73-a47d-1303e013e068 (ff8bb960-28a7-4e73-a47d-1303e013e068): created successfully Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1804bf56-4206-4a20-953b-7a48a66fccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (64c7f505-88e5-4f72-ba03-5099195af3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:14 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e710bfdd-e7d5-4fa7-a8d9-3ac95ef409ee tempest-GroupSnapshotsTest-358805566 None] Created volume successfully. Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:15 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" returned: 0 in 1.332s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:15 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:15 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b" released by "delete_volume" :: held 2.588s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:15 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['2a18f995-e7e0-46bf-bffb-3eeaee2a2a5f', '407cf196-4ce4-4c4f-b5a1-3fbdbbed59e3', '633f0204-55d9-4ba2-9d89-b8e22f69bda6', 'e538cb4e-73a9-4456-9e61-788e034364f2'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:16 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:16 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (f036a481-7c93-48b4-be31-89f06309f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c980039-fa94-4aa9-8f50-9bbcbf14f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c980039-fa94-4aa9-8f50-9bbcbf14f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-480476008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cece4668-e4af-4654-964a-436e99dbdcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:16Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06820e9-fe13-4f9e-8535-e61acdbf0bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06820e9-fe13-4f9e-8535-e61acdbf0bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d84b6d7-90f7-4ad2-9fa1-c5899b1abd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d84b6d7-90f7-4ad2-9fa1-c5899b1abd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cece4668-e4af-4654-964a-436e99dbdcf6', 'volume_name': 'volume-cece4668-e4af-4654-964a-436e99dbdcf6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8943496d-93e5-4c07-b646-1cb59a3df686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8943496d-93e5-4c07-b646-1cb59a3df686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82dd97df-eb50-4891-b75e-80b14c61c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Volume cece4668-e4af-4654-964a-436e99dbdcf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cece4668-e4af-4654-964a-436e99dbdcf6', 'volume_size': 1} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-480476008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cece4668-e4af-4654-964a-436e99dbdcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:16Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Creating volume cece4668-e4af-4654-964a-436e99dbdcf6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:16 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:16 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 1073741824 Jul 07 22:42:16 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-7f01168a-1ca3-4866-96bd-4b3b844bc19e-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-7f01168a-1ca3-4866-96bd-4b3b844bc19e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Deleting offline snapshot 7f01168a-1ca3-4866-96bd-4b3b844bc19e of volume 276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] snapshot_file for this snap is: volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[63278d5f-24f5-4e96-941b-a59acb43eb8a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:17 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:42:17 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:17 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.744s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:42:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] GroupSnapshot 06518461-6145-4c7b-9d3f-6ecdff953092: creating. Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Group snapshot 06518461-6145-4c7b-9d3f-6ecdff953092: creating. {{(pid=88087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:17 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.487s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleted volume successfully. Jul 07 22:42:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a62c62b0-2d8f-4fa6-8523-7eab4985b620 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-28e2e2bc-6df6-46c3-b8bb-d3f4a106021b-delete_volume" released by "delete_volume" :: held 4.738s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:18 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 1073741824" returned: 0 in 1.986s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:18 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 1.513s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276ec905-7d27-464c-b6d4-3a7ceafad10d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:18 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 Jul 07 22:42:18 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e0c76d-9735-432a-98d1-69973420f796]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:18 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:42:18 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:19 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6" returned: 0 in 0.886s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (2933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.937s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.813s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Creating offline snapshot 34f50b63-7cc6-40cc-b792-1d1d390c2c09 of volume ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:42:19 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82dd97df-eb50-4891-b75e-80b14c61c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cece4668-e4af-4654-964a-436e99dbdcf6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a662846-c0d1-4bf8-a9f2-70f38050e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361af99-1828-4433-88df-ee97ec1c4ca2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Volume volume-cece4668-e4af-4654-964a-436e99dbdcf6 (cece4668-e4af-4654-964a-436e99dbdcf6): created successfully Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a662846-c0d1-4bf8-a9f2-70f38050e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (f036a481-7c93-48b4-be31-89f06309f26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:19 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:42:19 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ca19df64-1c8d-45a8-9585-e402554e6ad7 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:42:19 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:19 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:20 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:20 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 1G Jul 07 22:42:20 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:20 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 0.897s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:20 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e Jul 07 22:42:20 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-cece4668-e4af-4654-964a-436e99dbdcf6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-cece4668-e4af-4654-964a-436e99dbdcf6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-quobyte-cece4668-e4af-4654-964a-436e99dbdcf6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-cece4668-e4af-4654-964a-436e99dbdcf6" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9aa8de-8e93-4842-9d4a-f87aa0a24df7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:21 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 Jul 07 22:42:21 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:21 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d.7f01168a-1ca3-4866-96bd-4b3b844bc19e" returned: 0 in 0.962s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-7f01168a-1ca3-4866-96bd-4b3b844bc19e" released by "_delete_snapshot" :: held 4.518s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" released by "delete_snapshot" :: held 4.581s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['9cdabf67-836e-4521-a0c2-361deb2600fe', 'd1791be3-843b-4e0f-a854-54cc06c5d798', '3f8c0d98-6000-4663-90a5-e8dca8779ce9', 'fce561ad-3fcf-4e25-a871-538e09364370'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Delete snapshot completed successfully. Jul 07 22:42:21 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 1G" returned: 0 in 1.266s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8bb960-28a7-4e73-a47d-1303e013e068 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e236be83-d5f4-4222-9187-5ec2d341018d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-7f01168a-1ca3-4866-96bd-4b3b844bc19e-delete_snapshot" released by "delete_snapshot" :: held 4.852s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:21 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8bb960-28a7-4e73-a47d-1303e013e068 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:21 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:21 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6" returned: 0 in 1.086s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:22 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6 Jul 07 22:42:22 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-276ec905-7d27-464c-b6d4-3a7ceafad10d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-276ec905-7d27-464c-b6d4-3a7ceafad10d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24d290-2ef3-45ea-8417-92a2fb961ce4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:22 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:42:22 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:22 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8bb960-28a7-4e73-a47d-1303e013e068 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:22 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:22 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:22 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:22 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cece4668-e4af-4654-964a-436e99dbdcf6" returned: 0 in 0.776s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-cece4668-e4af-4654-964a-436e99dbdcf6" released by "delete_volume" :: held 1.954s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Created reservations ['d718906d-7e65-4db8-aee6-5539d9a57266', 'd68c5d14-f61a-414d-95c6-5cc0d9d9fb4a', 'f7fdcc2e-ba74-47ea-ac7f-f35c8dc34054', 'f623c643-df94-4bdb-a148-2c8602289b8c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:22 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:22 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:23 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 0.848s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:23 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.720s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:23 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d Jul 07 22:42:23 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:23 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info Jul 07 22:42:23 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (e0fc0d17-0830-48a1-a96d-517b9948ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73807edb-3059-4338-838f-78d055f330e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73807edb-3059-4338-838f-78d055f330e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1444451124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324c8738-006f-4bea-b3c6-7bafa0917831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:24Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e86263-a300-4b56-b05d-ae570a861323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e86263-a300-4b56-b05d-ae570a861323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9b4200-f21e-4c38-935b-71998af90f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9b4200-f21e-4c38-935b-71998af90f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324c8738-006f-4bea-b3c6-7bafa0917831', 'volume_name': 'volume-324c8738-006f-4bea-b3c6-7bafa0917831', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c813ed3-8490-4248-9be4-4a487dab61b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c813ed3-8490-4248-9be4-4a487dab61b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed06db5-97c7-4ae3-8c00-b1ecf9527a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:23 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Volume 324c8738-006f-4bea-b3c6-7bafa0917831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324c8738-006f-4bea-b3c6-7bafa0917831', 'volume_size': 1} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:23 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-276ec905-7d27-464c-b6d4-3a7ceafad10d" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-276ec905-7d27-464c-b6d4-3a7ceafad10d" released by "delete_volume" :: held 1.787s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:23 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.068s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:23 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Deleted volume successfully. Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['7b2478d9-e126-4c34-8eba-c3fe7c9fec7e', '98aa4260-9242-4238-b2fb-484828124192', 'e9d550ad-1515-40b0-b6c6-ee25e2407cb9', '4dae570d-dc57-46a0-980b-c79f35371505'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ee884d7a-ba41-4112-adf2-7d49ee457436 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-cece4668-e4af-4654-964a-436e99dbdcf6-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:24 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info" returned: 0 in 0.960s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:24 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:24 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info Jul 07 22:42:24 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:24 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:24 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:24 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:24 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.720s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.info" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.583s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1444451124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324c8738-006f-4bea-b3c6-7bafa0917831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:24Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Creating volume 324c8738-006f-4bea-b3c6-7bafa0917831 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:24 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleted volume successfully. Jul 07 22:42:24 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 1073741824 Jul 07 22:42:24 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-314f31c7-bdb1-433b-b53b-ddd812e30622 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-276ec905-7d27-464c-b6d4-3a7ceafad10d-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f625a884-7a1d-41eb-9545-c4324e6ca407 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 06518461-6145-4c7b-9d3f-6ecdff953092: created successfully Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (9500cd55-7f87-4eb3-b245-36104ae5f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50fc567-3e0e-41ad-a31d-75b12a768f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50fc567-3e0e-41ad-a31d-75b12a768f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1623336538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76610217-082d-4a3c-8046-a08a8616516a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:25Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f42d87-22b2-4aea-9f67-4eea585c9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f42d87-22b2-4aea-9f67-4eea585c9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273dc79-0d9a-4c7a-a611-119d50c26301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273dc79-0d9a-4c7a-a611-119d50c26301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76610217-082d-4a3c-8046-a08a8616516a', 'volume_name': 'volume-76610217-082d-4a3c-8046-a08a8616516a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aa571c-e42c-40f4-b64a-5c69cc6d7021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aa571c-e42c-40f4-b64a-5c69cc6d7021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a1b30-dd11-45bf-8850-0541f1ae0f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:25 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume 76610217-082d-4a3c-8046-a08a8616516a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76610217-082d-4a3c-8046-a08a8616516a', 'volume_size': 1} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:25 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 1073741824" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:25 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 Jul 07 22:42:25 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:26 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831" returned: 0 in 0.744s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1623336538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76610217-082d-4a3c-8046-a08a8616516a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:25Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Creating volume 76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:26 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed06db5-97c7-4ae3-8c00-b1ecf9527a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324c8738-006f-4bea-b3c6-7bafa0917831', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefa0d2e-6b10-44cc-a5e6-23fa4efacb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:26 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a 1073741824 Jul 07 22:42:26 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:26 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Volume volume-324c8738-006f-4bea-b3c6-7bafa0917831 (324c8738-006f-4bea-b3c6-7bafa0917831): created successfully Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefa0d2e-6b10-44cc-a5e6-23fa4efacb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (e0fc0d17-0830-48a1-a96d-517b9948ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d7fbfadb-7922-4ce1-a08b-14e930e27124 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:42:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:27 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a 1073741824" returned: 0 in 0.972s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:27 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:42:27 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-324c8738-006f-4bea-b3c6-7bafa0917831-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-324c8738-006f-4bea-b3c6-7bafa0917831-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-quobyte-324c8738-006f-4bea-b3c6-7bafa0917831" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-324c8738-006f-4bea-b3c6-7bafa0917831" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abaa5c0-92f4-4ea5-90b5-eadd8fc80cc2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:28 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 Jul 07 22:42:28 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:28 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.740s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.268s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09-d0b97dca-38a9-43a4-9f07-bcc424894e41" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a1b30-dd11-45bf-8850-0541f1ae0f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76610217-082d-4a3c-8046-a08a8616516a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ed070f-5184-4d0e-9464-3fe49df17b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09-d0b97dca-38a9-43a4-9f07-bcc424894e41" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Creating volume d0b97dca-38a9-43a4-9f07-bcc424894e41 from snapshot 34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Volume volume-76610217-082d-4a3c-8046-a08a8616516a (76610217-082d-4a3c-8046-a08a8616516a): created successfully Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ed070f-5184-4d0e-9464-3fe49df17b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (9500cd55-7f87-4eb3-b245-36104ae5f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] snapshot: 34f50b63-7cc6-40cc-b792-1d1d390c2c09, volume: d0b97dca-38a9-43a4-9f07-bcc424894e41, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:42:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c5240399-036f-4c2b-9d33-9871cad7bc7e tempest-VolumesSnapshotTestJSON-1437457769 None] Created volume successfully. Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c095d9-bd15-40af-b0c7-e719b8119256]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:28 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:28 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:29 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:29 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831 Jul 07 22:42:29 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:29 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff8bb960-28a7-4e73-a47d-1303e013e068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc921f-58f9-4357-8f23-fac584b2db58]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:29 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:29 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:29 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-324c8738-006f-4bea-b3c6-7bafa0917831" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-324c8738-006f-4bea-b3c6-7bafa0917831" released by "delete_volume" :: held 1.736s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:29 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Created reservations ['f5077a41-2599-4b59-a6e6-d2984831c957', 'e0c5fcaf-0ba0-4982-b3dc-0100a7955890', 'de915c9e-9d7f-4c6d-9d69-fbf39071c772', '93b607ad-795e-41e8-a46c-f321f25639ca'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:30 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:30 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:30 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 0.935s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:30 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 Jul 07 22:42:30 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:30 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Deleted volume successfully. Jul 07 22:42:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d70773f4-1e98-4ea8-88c2-61322e9cc102 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-324c8738-006f-4bea-b3c6-7bafa0917831-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (544e8fde-3ebf-4ae5-aca2-d7db7ba2ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc822184-5ecd-404e-9713-3ed2f5d7b407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc822184-5ecd-404e-9713-3ed2f5d7b407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1934667349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116affdb-d586-4a08-b1d9-d6864303575f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:31Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4c87eb-4452-4c34-b8d6-ca5c38efb1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4c87eb-4452-4c34-b8d6-ca5c38efb1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbcc7ea-8382-44e8-9243-acaf65488b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbcc7ea-8382-44e8-9243-acaf65488b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116affdb-d586-4a08-b1d9-d6864303575f', 'volume_name': 'volume-116affdb-d586-4a08-b1d9-d6864303575f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97f658b-7220-41e6-9956-2399db9706cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97f658b-7220-41e6-9956-2399db9706cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f09a1c-6920-4314-b4cb-04c00e96bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:31 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Volume 116affdb-d586-4a08-b1d9-d6864303575f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116affdb-d586-4a08-b1d9-d6864303575f', 'volume_size': 1} Jul 07 22:42:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:35 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41" returned: 0 in 5.142s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:35 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[63000eaa-3d7b-4574-b5b8-e5e42f097047]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:35 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:35 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:36 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 0.921s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:36 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:42:36 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Converted 1024.00 MB image at 199.12 MB/s Jul 07 22:42:36 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:42:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:36 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 Jul 07 22:42:36 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:37 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41" returned: 0 in 0.619s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" released by "_copy_volume_from_snapshot" :: held 8.657s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09-d0b97dca-38a9-43a4-9f07-bcc424894e41" released by "_create_volume_from_snapshot" :: held 8.718s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.752s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.562s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Creating offline snapshot f50bc397-6313-4c20-a2a8-4e3c4c6ce23d of volume 76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ed2ff-badf-4aab-a511-3a50e18ac700]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-612768c3-5c19-454c-8ed9-e76a903f63fc tempest-GroupSnapshotsTest-358805566 None] Create group from source-snapshot-06518461-6145-4c7b-9d3f-6ecdff953092 completed successfully. Jul 07 22:42:37 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:42:37 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:38 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:38 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d 1G Jul 07 22:42:38 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4746c4e-8080-4d63-84ed-4f2dc0b77c88]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:38 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 Jul 07 22:42:38 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:38 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d 1G" returned: 0 in 0.823s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76610217-082d-4a3c-8046-a08a8616516a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:38 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76610217-082d-4a3c-8046-a08a8616516a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:42:38 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:38 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41" returned: 0 in 0.772s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:39 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41 Jul 07 22:42:39 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:39 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76610217-082d-4a3c-8046-a08a8616516a -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 0.711s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:39 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d is being set with open permissions: ugo+rw Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:39 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:39 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:42:39 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d0b97dca-38a9-43a4-9f07-bcc424894e41" returned: 0 in 0.628s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-d0b97dca-38a9-43a4-9f07-bcc424894e41" released by "delete_volume" :: held 1.454s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['0b183a42-1b34-4c79-88e1-ffd215f86cd9'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:39 devstack cinder-volume[88087]: WARNING cinder.quota [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-542008723 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-542008723, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:42:39 devstack cinder-volume[88087]: WARNING cinder.quota [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-542008723 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-542008723, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['87a276e7-efae-411a-9738-e025ab237000', '006caeca-b699-4f8c-90c6-c416a60981bc', 'adeacf50-85df-4f27-8c2f-dc4673726238', 'ea186e9c-90af-4e2e-aca5-b7a16a65a836'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:39 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:39 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:40 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 0.695s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:40 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info Jul 07 22:42:40 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:40 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.655s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ff9209cb-46f6-4df1-8c47-3e5f722d16f0 tempest-GroupSnapshotsTest-358805566 None] Delete group completed successfully. Jul 07 22:42:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 06518461-6145-4c7b-9d3f-6ecdff953092: deleting Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 06518461-6145-4c7b-9d3f-6ecdff953092: deleting {{(pid=88087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Deleting offline snapshot 34f50b63-7cc6-40cc-b792-1d1d390c2c09 of volume ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] snapshot_file for this snap is: volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3310c-976e-46aa-8238-0f340fb456c7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:40 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:40 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:41 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info" returned: 0 in 0.673s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:41 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info is being set with open permissions: ugo+rw Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:41 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info Jul 07 22:42:41 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:41 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.845s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff8bb960-28a7-4e73-a47d-1303e013e068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:41 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b25454-1575-4344-ae3a-98e5996ddbfc]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.info" returned: 0 in 0.668s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.551s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1934667349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116affdb-d586-4a08-b1d9-d6864303575f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:31Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Creating volume 116affdb-d586-4a08-b1d9-d6864303575f {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:41 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f 1073741824 Jul 07 22:42:41 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-eee5f0a1-be38-4fdf-ace3-f785f889d27f tempest-VolumesSnapshotTestJSON-1437457769 None] Create snapshot completed successfully Jul 07 22:42:41 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:41 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:42 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 0.785s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:42 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:42 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:42 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f 1073741824" returned: 0 in 0.865s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:42 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f Jul 07 22:42:42 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (a11a6c76-8aa3-4caa-a3cf-f5540aad2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83729ab5-f0e0-4d0d-9075-a8c559a76576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83729ab5-f0e0-4d0d-9075-a8c559a76576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-718655963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f0662c-07ea-4ea6-8516-64b13ba97b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da345155377842218df1810d3f7614a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f50bc397-6313-4c20-a2a8-4e3c4c6ce23d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:43Z,use_quota=True,user_id='f1960572da1a40319167fcd7199659c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73354a7e-be71-4411-bd76-2894e9d93264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73354a7e-be71-4411-bd76-2894e9d93264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa04e43-4fa4-4d7d-a3e7-d7d3c14a9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa04e43-4fa4-4d7d-a3e7-d7d3c14a9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2f0662c-07ea-4ea6-8516-64b13ba97b64', 'volume_name': 'volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64', 'volume_size': 1, 'snapshot_id': 'f50bc397-6313-4c20-a2a8-4e3c4c6ce23d'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6eec2b-0833-4ce6-bb8a-8d5603e83632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6eec2b-0833-4ce6-bb8a-8d5603e83632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4e89a7-e3a2-4ff9-bd85-838cc4aedfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume b2f0662c-07ea-4ea6-8516-64b13ba97b64: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64', 'volume_size': 1, 'snapshot_id': 'f50bc397-6313-4c20-a2a8-4e3c4c6ce23d'} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.847s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:43 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09 Jul 07 22:42:43 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:43 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f" returned: 0 in 0.729s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.058s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f09a1c-6920-4314-b4cb-04c00e96bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116affdb-d586-4a08-b1d9-d6864303575f', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2c32f4-a5a1-4c5a-ae85-42f03f5d6241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c7436-0bae-43e1-87b5-1aea28f398f9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Volume volume-116affdb-d586-4a08-b1d9-d6864303575f (116affdb-d586-4a08-b1d9-d6864303575f): created successfully Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2c32f4-a5a1-4c5a-ae85-42f03f5d6241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (544e8fde-3ebf-4ae5-aca2-d7db7ba2ea04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-98635e81-2829-4211-b9b4-1f960cabc518 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:42:43 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 Jul 07 22:42:43 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:43 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068.34f50b63-7cc6-40cc-b792-1d1d390c2c09" returned: 0 in 0.630s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-34f50b63-7cc6-40cc-b792-1d1d390c2c09" released by "_delete_snapshot" :: held 3.210s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" released by "delete_snapshot" :: held 3.238s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:44 devstack cinder-volume[88087]: WARNING cinder.quota [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-542008723 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-542008723, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['420afb6e-a361-4b94-a6fc-62810f4e3941', '3ed0ee5b-8e44-4c1c-a49a-1cf5007976d1', '3f81c59b-45ab-49f0-9e80-2fa481e94cf9', '7869172c-c9d6-472f-b773-8df95bd88224'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1896d3f1-4063-48a0-aa37-9785c173e560 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 06518461-6145-4c7b-9d3f-6ecdff953092: deleted successfully Jul 07 22:42:44 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.893s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-b2f0662c-07ea-4ea6-8516-64b13ba97b64" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-b2f0662c-07ea-4ea6-8516-64b13ba97b64" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Creating volume b2f0662c-07ea-4ea6-8516-64b13ba97b64 from snapshot f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-c87d294a-f7b9-413f-90b9-78d907c13175', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6cca43b-244d-488f-a537-ea0ae209d842', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] snapshot: f50bc397-6313-4c20-a2a8-4e3c4c6ce23d, volume: b2f0662c-07ea-4ea6-8516-64b13ba97b64, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0468e33-87a1-4ee1-aaa8-c08f7ee1eabf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-35d1c8ef-863b-440e-b878-6ef0376bfab2 req-6971a09c-8de8-42db-a478-f827918c5fb9 tempest-TestInstancesWithCinderVolumes-1303876687 None] attachment_update completed successfully. Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-116affdb-d586-4a08-b1d9-d6864303575f-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "cinder-116affdb-d586-4a08-b1d9-d6864303575f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:44 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:42:44 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-quobyte-116affdb-d586-4a08-b1d9-d6864303575f" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-116affdb-d586-4a08-b1d9-d6864303575f" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93440e62-da53-4b66-88bf-397bed6dc1c7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:44 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f Jul 07 22:42:44 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:45 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 0.801s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76610217-082d-4a3c-8046-a08a8616516a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e670533-e061-429b-9c1f-be5ba19b684c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:45 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:42:45 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:45 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:45 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f Jul 07 22:42:45 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca5458-7142-4e6a-9702-7a90a28b3081]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:45 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:45 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:46 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.948s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:46 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 Jul 07 22:42:46 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:46 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-116affdb-d586-4a08-b1d9-d6864303575f" returned: 0 in 0.797s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-116affdb-d586-4a08-b1d9-d6864303575f" released by "delete_volume" :: held 1.660s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Created reservations ['37b98c38-6c0d-4703-a8b1-308a857c4a81', 'f7dc8e3c-2fd2-45fc-8dbc-eb909743a459', '9bfe1fc9-3a36-41c8-9469-283d95e05f09', '6bc4cbc9-a8da-4c0a-b9ca-ef8c2570a343'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:46 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:46 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:46 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 0.901s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:46 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068 Jul 07 22:42:46 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:47 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.776s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Deleted volume successfully. Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b8f8c73e-3237-4faf-9a22-3fa6dc22e0ae tempest-VolumesActionsTest-1918897331 None] Lock "cinder-116affdb-d586-4a08-b1d9-d6864303575f-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:47 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff8bb960-28a7-4e73-a47d-1303e013e068" returned: 0 in 1.049s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-ff8bb960-28a7-4e73-a47d-1303e013e068" released by "delete_volume" :: held 2.073s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['f4008d63-7923-4682-8570-87c582afd018'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:47 devstack cinder-volume[88087]: WARNING cinder.db.api [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-542008723'] Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['efda31f5-5a04-48c8-b2d1-3493dc4b37bf', '75e426a2-9364-4cdc-be52-94a406f41579', '219b2add-111f-4036-9f00-76d1a78e0878', '4e7667c7-f4af-47b7-99f0-e6a956c5b0e7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (ee14d125-13e9-4673-9a4c-e7e64b485f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762e0253-f6af-4365-8324-35603762429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762e0253-f6af-4365-8324-35603762429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242890384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6983f1cb-0917-4b68-8227-503625402673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:48Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98b08e1-f400-4769-90e1-7d61fe45d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98b08e1-f400-4769-90e1-7d61fe45d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8dee2a-dac5-4d91-8e70-032e2a29400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8dee2a-dac5-4d91-8e70-032e2a29400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6983f1cb-0917-4b68-8227-503625402673', 'volume_name': 'volume-6983f1cb-0917-4b68-8227-503625402673', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c93dda1-556c-4cdd-9fe4-c86f040431c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c93dda1-556c-4cdd-9fe4-c86f040431c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630331c0-e429-4d5c-9502-bba7ac807f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Volume 6983f1cb-0917-4b68-8227-503625402673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6983f1cb-0917-4b68-8227-503625402673', 'volume_size': 1} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:48 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:48 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:49 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.283s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:49 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-33b752f9-caef-4833-abf9-50957b662f76 tempest-GroupSnapshotsTest-358805566 None] Delete group completed successfully. Jul 07 22:42:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4f4e3882-0927-4681-97b6-8215dd5166cd tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-753332199: creating Jul 07 22:42:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4f4e3882-0927-4681-97b6-8215dd5166cd tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-753332199: created successfully Jul 07 22:42:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4f4e3882-0927-4681-97b6-8215dd5166cd tempest-GroupSnapshotsTest-358805566 None] Create group completed successfully. Jul 07 22:42:51 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64" returned: 0 in 5.637s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b4510f-bc55-436c-a1ee-a04bb40c9823]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:51 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:42:51 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (efd5cff0-0cc5-40b6-bb7f-a46671665362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dad0786-d8bb-4737-b47f-ec8a3f0a48e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dad0786-d8bb-4737-b47f-ec8a3f0a48e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906603438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,host='devstack@QuobyteHD#QuobyteHD',id=68d601df-c0a5-4b26-b842-256e7433133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:52Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c39984-318f-4ae6-8bb7-a0c3a510c3aa),volume_type_id=c7c39984-318f-4ae6-8bb7-a0c3a510c3aa)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aad015-a358-4c8f-8613-834252e4b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aad015-a358-4c8f-8613-834252e4b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5458d8-f699-4adb-bbda-568cb31c1e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5458d8-f699-4adb-bbda-568cb31c1e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d601df-c0a5-4b26-b842-256e7433133e', 'volume_name': 'volume-68d601df-c0a5-4b26-b842-256e7433133e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f338a8-c603-4728-bfdd-0f74512dac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f338a8-c603-4728-bfdd-0f74512dac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb04406-1f1f-405e-821d-384cfa685184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:52 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Volume 68d601df-c0a5-4b26-b842-256e7433133e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d601df-c0a5-4b26-b842-256e7433133e', 'volume_size': 1} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:52 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.916s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:42:52 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Converted 1024.00 MB image at 181.60 MB/s Jul 07 22:42:52 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 is being set with open permissions: ugo+rw Jul 07 22:42:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:52 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 Jul 07 22:42:52 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:53 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64" returned: 0 in 0.653s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" released by "_copy_volume_from_snapshot" :: held 9.059s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-b2f0662c-07ea-4ea6-8516-64b13ba97b64" released by "_create_volume_from_snapshot" :: held 9.094s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.120s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242890384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6983f1cb-0917-4b68-8227-503625402673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:48Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Creating volume 6983f1cb-0917-4b68-8227-503625402673 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:53 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 1073741824 Jul 07 22:42:53 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4e89a7-e3a2-4ff9-bd85-838cc4aedfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64', 'volume_size': 1, 'snapshot_id': 'f50bc397-6313-4c20-a2a8-4e3c4c6ce23d'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e5b325-4fc1-4164-b04a-56cd83988d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:53 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Volume volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 (b2f0662c-07ea-4ea6-8516-64b13ba97b64): created successfully Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e5b325-4fc1-4164-b04a-56cd83988d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Flow 'volume_create_manager' (a11a6c76-8aa3-4caa-a3cf-f5540aad2946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-46d805ea-7c87-4bdb-bd76-ffe52ff3b641 tempest-VolumesSnapshotTestJSON-1437457769 None] Created volume successfully. Jul 07 22:42:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:54 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 1073741824" returned: 0 in 0.936s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:54 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 Jul 07 22:42:54 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-b2f0662c-07ea-4ea6-8516-64b13ba97b64-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-b2f0662c-07ea-4ea6-8516-64b13ba97b64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93770dbf-4d22-46c6-8b33-e0ec72ec78c6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:54 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 Jul 07 22:42:54 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:55 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673" returned: 0 in 0.879s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,created_at=2026-07-07T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906603438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,host='devstack@QuobyteHD#QuobyteHD',id=68d601df-c0a5-4b26-b842-256e7433133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:52Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c39984-318f-4ae6-8bb7-a0c3a510c3aa),volume_type_id=c7c39984-318f-4ae6-8bb7-a0c3a510c3aa)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Creating volume 68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:55 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:55 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e 1073741824 Jul 07 22:42:55 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630331c0-e429-4d5c-9502-bba7ac807f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6983f1cb-0917-4b68-8227-503625402673', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd4c4ee-6cee-4577-adbb-660c77f762b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Volume volume-6983f1cb-0917-4b68-8227-503625402673 (6983f1cb-0917-4b68-8227-503625402673): created successfully Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd4c4ee-6cee-4577-adbb-660c77f762b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (ee14d125-13e9-4673-9a4c-e7e64b485f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c554380e-1973-44ff-806d-f98a0a396c10 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:42:55 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64" returned: 0 in 0.974s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:55 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64 Jul 07 22:42:55 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-6983f1cb-0917-4b68-8227-503625402673-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-6983f1cb-0917-4b68-8227-503625402673-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "cinder-quobyte-6983f1cb-0917-4b68-8227-503625402673" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-6983f1cb-0917-4b68-8227-503625402673" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278ea6c-84d6-4be9-890b-8693a1baf7d1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:56 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 Jul 07 22:42:56 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:56 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e 1073741824" returned: 0 in 1.075s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:56 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b2f0662c-07ea-4ea6-8516-64b13ba97b64" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-b2f0662c-07ea-4ea6-8516-64b13ba97b64" released by "delete_volume" :: held 1.867s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:56 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e Jul 07 22:42:56 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['8983ee3c-10fb-4d12-8773-1e61f30850d5', 'c5d8e159-38d0-489d-b0a2-18f96775ec06', '6e13580d-0d82-4140-b33b-1be12400a222', '5a6b64f0-418c-4a77-a92b-615c147ff36d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:56 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:56 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Deleting offline snapshot f50bc397-6313-4c20-a2a8-4e3c4c6ce23d of volume 76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:42:57 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] snapshot_file for this snap is: volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673" returned: 0 in 1.058s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[732868e3-7a70-4eb6-8243-9fc4efafd5a9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:57 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673 Jul 07 22:42:57 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:57 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e" returned: 0 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.381s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb04406-1f1f-405e-821d-384cfa685184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d601df-c0a5-4b26-b842-256e7433133e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a7ea5a-53cd-4a2b-bfb7-61a08fea9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[622d4ce5-b7e3-4df0-af17-1e8f3e090f49]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:57 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:42:57 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Volume volume-68d601df-c0a5-4b26-b842-256e7433133e (68d601df-c0a5-4b26-b842-256e7433133e): created successfully Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a7ea5a-53cd-4a2b-bfb7-61a08fea9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (efd5cff0-0cc5-40b6-bb7f-a46671665362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a8d9d08b-d304-484a-a0e9-7ae00ea98271 tempest-GroupSnapshotsTest-358805566 None] Created volume successfully. Jul 07 22:42:57 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a Jul 07 22:42:57 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:57 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.961s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleted volume successfully. Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3b536326-3f36-4c33-afcc-51a62c7cfb70 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-b2f0662c-07ea-4ea6-8516-64b13ba97b64-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:57 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6983f1cb-0917-4b68-8227-503625402673" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-quobyte-6983f1cb-0917-4b68-8227-503625402673" released by "delete_volume" :: held 1.947s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:57 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Created reservations ['17e0c87c-5ebe-49eb-b5dd-8cd781a773a8', 'd6c92461-42e7-4057-a6f5-212e950e5b55', '9dd10916-81f9-47d9-a3a2-2f2181bc6068', 'f20e846b-40da-4311-9e92-1d1005795c05'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:58 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 1.035s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76610217-082d-4a3c-8046-a08a8616516a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:58 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:42:58 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df874e-c283-43ca-ac55-8518bfdace26]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:58 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" returned: 0 in 0.949s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd77d6184-f162-40c0-aea9-3eece7857687', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:42:58 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:42:58 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-26bf70d2-c1dd-41b9-b8ac-d75997429ef2 req-958f72a6-da98-4c9c-a77a-32f4411e3f38 tempest-TestInstancesWithCinderVolumes-1303876687 None] attachment_update completed successfully. Jul 07 22:42:58 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.849s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:58 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Deleted volume successfully. Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5d9b315b-f648-4689-8839-eafa31f31d13 tempest-VolumesActionsTest-1918897331 None] Lock "cinder-6983f1cb-0917-4b68-8227-503625402673-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (041f233f-413e-4415-ad74-14d4492128c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cc692c-063a-47c1-b659-c8bf45a247b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cc692c-063a-47c1-b659-c8bf45a247b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965530406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,host='devstack@QuobyteHD#QuobyteHD',id=656be993-391e-489c-bcb8-6e364f8c737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:59Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c39984-318f-4ae6-8bb7-a0c3a510c3aa),volume_type_id=c7c39984-318f-4ae6-8bb7-a0c3a510c3aa)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d246d-8bf8-49c0-acdb-4c6e5f70c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d246d-8bf8-49c0-acdb-4c6e5f70c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecbb553-76f3-451e-9777-aebef3a0c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecbb553-76f3-451e-9777-aebef3a0c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656be993-391e-489c-bcb8-6e364f8c737c', 'volume_name': 'volume-656be993-391e-489c-bcb8-6e364f8c737c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd2c4fe-41e4-4f23-b7d8-fec60e449d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd2c4fe-41e4-4f23-b7d8-fec60e449d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2641d1ac-ced8-47e9-92c0-1e970e69841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Volume 656be993-391e-489c-bcb8-6e364f8c737c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656be993-391e-489c-bcb8-6e364f8c737c', 'volume_size': 1} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,created_at=2026-07-07T20:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965530406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0c3158f-6205-4cab-bbd7-01b57f8c6252,host='devstack@QuobyteHD#QuobyteHD',id=656be993-391e-489c-bcb8-6e364f8c737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:59Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c39984-318f-4ae6-8bb7-a0c3a510c3aa),volume_type_id=c7c39984-318f-4ae6-8bb7-a0c3a510c3aa)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Creating volume 656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:59 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:59 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 1.045s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:59 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c 1073741824 Jul 07 22:42:59 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:59 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:42:59 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (b683ca17-8741-4dd9-ae82-debf9b899466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f309632e-b0b4-4af4-bcd7-a352c9f2feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f309632e-b0b4-4af4-bcd7-a352c9f2feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-437245601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0daf4a7-11e8-4c88-ad8f-0a3de59bde53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:00Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3835da-c356-47d1-accc-76d152b36359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3835da-c356-47d1-accc-76d152b36359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff3f4a-49e9-4f8d-b296-601eddc9fd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aff3f4a-49e9-4f8d-b296-601eddc9fd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0daf4a7-11e8-4c88-ad8f-0a3de59bde53', 'volume_name': 'volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffb759-56fd-4b9e-948d-1c75f3c322c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffb759-56fd-4b9e-948d-1c75f3c322c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac990456-5716-4f1e-8ba5-852b6b28bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Volume f0daf4a7-11e8-4c88-ad8f-0a3de59bde53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53', 'volume_size': 1} Jul 07 22:42:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:00 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 0.885s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:00 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d Jul 07 22:43:00 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:00 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c 1073741824" returned: 0 in 1.067s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=109,cinder:INSERT=30,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:00 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c Jul 07 22:43:00 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:00 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a.f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" returned: 0 in 0.692s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d" released by "_delete_snapshot" :: held 3.812s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" released by "delete_snapshot" :: held 3.846s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['b868a81e-bcb9-40ed-945e-d89d88b1ad23', 'ef6232ea-6dc0-4995-93fa-505b6fc2062b', 'bbd64232-0d70-4537-9791-e1a9ec821566', '0add6067-b99e-497a-95f5-e45abb38b4af'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Delete snapshot completed successfully. Jul 07 22:43:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1eb4bd9-b331-469e-8aa7-9b299e80a40d tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-f50bc397-6313-4c20-a2a8-4e3c4c6ce23d-delete_snapshot" released by "delete_snapshot" :: held 3.997s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:01 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-437245601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0daf4a7-11e8-4c88-ad8f-0a3de59bde53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9379e714a8484c3cb011018a62dd5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:00Z,use_quota=True,user_id='137a0bac1dd24344956cc3dab7d350ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Creating volume f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:01 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:01 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 1073741824 Jul 07 22:43:01 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2641d1ac-ced8-47e9-92c0-1e970e69841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656be993-391e-489c-bcb8-6e364f8c737c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fadcf2d-0195-426f-b4cc-f32dc8200c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:01 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Volume volume-656be993-391e-489c-bcb8-6e364f8c737c (656be993-391e-489c-bcb8-6e364f8c737c): created successfully Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fadcf2d-0195-426f-b4cc-f32dc8200c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (041f233f-413e-4415-ad74-14d4492128c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:01 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-97950269-a8a5-41dd-a2e3-596fa5b903a8 tempest-GroupSnapshotsTest-358805566 None] Created volume successfully. Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-76610217-082d-4a3c-8046-a08a8616516a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-76610217-082d-4a3c-8046-a08a8616516a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd5e1e-3ff4-47f7-afb4-86ddccc2d386]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:01 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:43:01 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:01 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-556315dd-ad37-4a2c-850e-f2187a8ba84b tempest-GroupSnapshotsTest-358805566 None] Update group completed successfully. Jul 07 22:43:02 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 1073741824" returned: 0 in 0.948s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:02 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 Jul 07 22:43:02 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:02 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.860s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:02 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a Jul 07 22:43:02 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:02 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" returned: 0 in 0.722s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac990456-5716-4f1e-8ba5-852b6b28bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523998bf-c13d-43d6-a3b9-66bd47a10511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Volume volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 (f0daf4a7-11e8-4c88-ad8f-0a3de59bde53): created successfully Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523998bf-c13d-43d6-a3b9-66bd47a10511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Flow 'volume_create_manager' (b683ca17-8741-4dd9-ae82-debf9b899466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-69931793-87bb-4855-8890-0b2eb6781ec8 tempest-VolumesActionsTest-1173254917 None] Created volume successfully. Jul 07 22:43:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f03ea9c4-026e-45ba-ad7e-7ac16a1c5762 tempest-GroupSnapshotsTest-358805566 None] Update group completed successfully. Jul 07 22:43:03 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-76610217-082d-4a3c-8046-a08a8616516a" returned: 0 in 0.737s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-76610217-082d-4a3c-8046-a08a8616516a" released by "delete_volume" :: held 1.680s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['af0a1f6a-1f9f-4a2b-a423-3c5afbd9378a', '59ea9dda-244a-4a31-b792-125c13bea235', '15a543c4-4cb3-40d8-a447-b1473e2dbd12', '4bf37b8c-3c6f-4876-b9c0-e938164f8f4a'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:03 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:03 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[445956e4-1fb5-4471-a57c-fca5d1cc958c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:04 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleted volume successfully. Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cecec81f-9c5f-4c6b-a7fb-4f37703865d3 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-76610217-082d-4a3c-8046-a08a8616516a-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:04 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 Jul 07 22:43:04 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cfd4e19d-e377-4840-8b3f-aa97fd442db5 tempest-GroupSnapshotsTest-358805566 None] Update group completed successfully. Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "cinder-quobyte-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-quobyte-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0308ddde-ea43-475c-b6a2-9540a5392137]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:04 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 Jul 07 22:43:04 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:04 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" returned: 0 in 0.887s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:04 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42 Jul 07 22:43:04 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:INSERT=37,cinder:UPDATE=153,cinder:SELECT=141,cinder:DELETE=7 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:43:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-001f71ab-fbf0-40bf-83fa-35913b919bf7 tempest-GroupSnapshotsTest-358805566 None] Update group completed successfully. Jul 07 22:43:05 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" returned: 0 in 0.901s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:05 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" returned: 0 in 0.763s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:05 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53 Jul 07 22:43:05 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-quobyte-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42" released by "delete_volume" :: held 1.731s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Created reservations ['b8124a49-b44f-467e-b6f2-0796d1562270', '1da4a0ff-e883-44b5-bf6f-3699fb859869', 'f23ab843-b6dc-4821-9a1b-850c3cee6aba', '604d92fc-3b49-4d45-88d7-db4f3bab8421'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:05 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:05 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:06 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" returned: 0 in 0.777s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-quobyte-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53" released by "delete_volume" :: held 1.727s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Created reservations ['7806ea5b-a0b6-4b28-a941-cc504340408a', '8c4e912f-ba6e-4d51-90bf-fdfc47a44136', '8e635a3b-3c52-4356-b819-9a1eb9380c7b', 'dff64ae9-cb5e-4751-ad26-896189e511da'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:06 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:06 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:06 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.813s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Deleted volume successfully. Jul 07 22:43:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-123ee735-6c09-4d6a-a65e-eb4f999bcdd5 tempest-VolumesSnapshotTestJSON-1437457769 None] Lock "cinder-d8dc3956-42a5-4a6b-b4c5-54f7a205fe42-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] GroupSnapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: creating. Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Group snapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: creating. {{(pid=88087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Creating offline snapshot 79bd1dc0-d710-4c65-8501-ffb9473697fa of volume 656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8fcc3-e0d5-4329-bc05-2aca3c1ace15]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:07 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c Jul 07 22:43:07 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:07 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.968s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Deleted volume successfully. Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cb3ddb3-c92b-4c76-a29a-84e592081b71 tempest-VolumesActionsTest-1173254917 None] Lock "cinder-f0daf4a7-11e8-4c88-ad8f-0a3de59bde53-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-ed7eb9db-fe0c-4651-9552-d106d185e321 req-7a79708c-b274-45a3-84bd-cca299b3815a tempest-TestInstancesWithCinderVolumes-1303876687 None] Terminate volume connection completed successfully. Jul 07 22:43:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-ed7eb9db-fe0c-4651-9552-d106d185e321 req-7a79708c-b274-45a3-84bd-cca299b3815a tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleting attachment c6cca43b-244d-488f-a537-ea0ae209d842. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:43:08 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c" returned: 0 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:08 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa 1G Jul 07 22:43:08 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:09 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa 1G" returned: 0 in 0.936s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656be993-391e-489c-bcb8-6e364f8c737c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:09 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656be993-391e-489c-bcb8-6e364f8c737c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa Jul 07 22:43:09 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-c87d294a-f7b9-413f-90b9-78d907c13175-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-c87d294a-f7b9-413f-90b9-78d907c13175-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-quobyte-c87d294a-f7b9-413f-90b9-78d907c13175" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-c87d294a-f7b9-413f-90b9-78d907c13175" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02e7f2-2791-407c-ad2e-3705d9e5d9d6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:10 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 Jul 07 22:43:10 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:10 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-656be993-391e-489c-bcb8-6e364f8c737c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa" returned: 0 in 1.033s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:10 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:10 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa Jul 07 22:43:10 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:11 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa" returned: 0 in 0.994s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:11 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info Jul 07 22:43:11 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:11 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175" returned: 0 in 1.410s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:11 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175 Jul 07 22:43:11 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:12 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info" returned: 0 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:12 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:12 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info Jul 07 22:43:12 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:12 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c87d294a-f7b9-413f-90b9-78d907c13175" returned: 0 in 1.139s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-c87d294a-f7b9-413f-90b9-78d907c13175" released by "delete_volume" :: held 2.640s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:12 devstack cinder-volume[88087]: WARNING cinder.quota [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1249738019-819842411 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1249738019-819842411, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:12 devstack cinder-volume[88087]: WARNING cinder.quota [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1249738019-819842411 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1249738019-819842411, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Created reservations ['944e85f7-7263-434c-83ee-afc016724891', '7d335573-aa44-44a3-8c42-fee76bbbe6fe', '65abbe43-e5c7-49ba-9d45-cd683cf063be', '9a555862-92bf-4e20-b800-b3fca887d658'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:12 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:12 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:13 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.info" returned: 0 in 0.940s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.963s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Creating offline snapshot a2c3dca3-1ea9-402b-9774-2010f986e6a5 of volume 68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab81a0-1d2d-4a6d-af0e-4ae5f38b3763]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:13 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e Jul 07 22:43:13 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:13 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:13 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleted volume successfully. Jul 07 22:43:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a405188a-6793-49a1-9bf6-313867cf863c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-c87d294a-f7b9-413f-90b9-78d907c13175-delete_volume" released by "delete_volume" :: held 4.013s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:14 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e" returned: 0 in 1.079s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:14 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 1G Jul 07 22:43:14 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:15 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Flow 'volume_create_manager' (a9615408-fcfd-44eb-aec4-3868a9cec2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7bec67-14bf-4906-9a7b-b09d2831855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 1G" returned: 0 in 1.117s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d601df-c0a5-4b26-b842-256e7433133e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:15 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:15 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:15 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d601df-c0a5-4b26-b842-256e7433133e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 Jul 07 22:43:15 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7bec67-14bf-4906-9a7b-b09d2831855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1643354840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=facab1dd-5cd8-4fbc-8058-3ab379b3ac08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8383a79b5341b9bec9086b2ba1c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:15Z,use_quota=True,user_id='35bfcc7e0c1c453e8f27ec4db6e32a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a883e9a-17c9-4698-aca4-63da40d47021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a883e9a-17c9-4698-aca4-63da40d47021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5971789-35ee-40aa-8ee8-47a490370cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5971789-35ee-40aa-8ee8-47a490370cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'facab1dd-5cd8-4fbc-8058-3ab379b3ac08', 'volume_name': 'volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8693ed04-53d7-417c-814c-e1315ddb8626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8693ed04-53d7-417c-814c-e1315ddb8626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6d838a-fe7e-498c-9bc9-c52d6f199736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08', 'volume_size': 1} Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-86e06e78-86e4-4f1f-944d-245c6bac277a req-a3a2de95-7558-4355-bedb-f688b62ddfa3 tempest-TestInstancesWithCinderVolumes-1303876687 None] Terminate volume connection completed successfully. Jul 07 22:43:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-86e06e78-86e4-4f1f-944d-245c6bac277a req-a3a2de95-7558-4355-bedb-f688b62ddfa3 tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleting attachment d77d6184-f162-40c0-aea9-3eece7857687. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:43:16 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:16 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d601df-c0a5-4b26-b842-256e7433133e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:16 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:43:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:43:16 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 Jul 07 22:43:16 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:17 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5" returned: 0 in 0.696s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:17 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info Jul 07 22:43:17 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-quobyte-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686de75-0e9b-4a6c-a7f3-bd91315dd63a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:17 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info" returned: 0 in 0.725s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:17 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:17 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info Jul 07 22:43:17 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:17 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a Jul 07 22:43:17 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:18 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.info" returned: 0 in 0.852s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:18 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.460s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.143s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1643354840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=facab1dd-5cd8-4fbc-8058-3ab379b3ac08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8383a79b5341b9bec9086b2ba1c8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:15Z,use_quota=True,user_id='35bfcc7e0c1c453e8f27ec4db6e32a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Creating volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:18 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" returned: 0 in 0.986s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:18 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 1073741824 Jul 07 22:43:18 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:18 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a Jul 07 22:43:18 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9ba58200-2163-48f7-95eb-375622a432b8 tempest-GroupSnapshotsTest-358805566 None] group_snapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: created successfully Jul 07 22:43:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] group_snapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: deleting Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] group_snapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: deleting {{(pid=88087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-79bd1dc0-d710-4c65-8501-ffb9473697fa" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-79bd1dc0-d710-4c65-8501-ffb9473697fa" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Deleting offline snapshot 79bd1dc0-d710-4c65-8501-ffb9473697fa of volume 656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] snapshot_file for this snap is: volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f5e83-b5c4-40c6-94c1-748092861691]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:19 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa Jul 07 22:43:19 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:19 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" returned: 0 in 1.218s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a" released by "delete_volume" :: held 2.284s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:20 devstack cinder-volume[88087]: WARNING cinder.quota [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566472760-17875858 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566472760-17875858, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:20 devstack cinder-volume[88087]: WARNING cinder.quota [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566472760-17875858 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566472760-17875858, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Created reservations ['c40e531b-74e3-4341-86b9-2758ed2fe89f', 'f2849d42-a1e5-485c-b2cc-74264e71b700', '6107992c-67f3-4f2b-90dc-2a2c47fbeadd', 'fa4a1f3d-7c87-4855-99a4-e0d4763992bb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:20 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:20 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:20 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 1073741824" returned: 0 in 1.636s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:20 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 Jul 07 22:43:20 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:21 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa" returned: 0 in 1.572s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-656be993-391e-489c-bcb8-6e364f8c737c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cb9c3-0708-4e39-a043-ba2bacde02f9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:21 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.056s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleted volume successfully. Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-50dac292-bc71-411d-a470-035850372b0c tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-a7bdd6f2-2a85-4c2a-ab31-cc6581596c6a-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Flow 'volume_create_manager' (0c5aeeb6-c2e5-4f8a-bfd4-866a0e2ce7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d15136-3481-4d8d-a5d8-2d4c6adb45ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c Jul 07 22:43:21 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d15136-3481-4d8d-a5d8-2d4c6adb45ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-494688931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a4431c-2aa4-4b45-bd7a-21c2d42782fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721e7de1ad7417f8a623e6af27ad525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:21Z,use_quota=True,user_id='10321e1c8a3f4bdeb95b122943645217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fc5c0b-1adc-494f-9e12-b749fd799c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fc5c0b-1adc-494f-9e12-b749fd799c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3685d3f-43ad-4f8f-ac47-b52bef0073f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3685d3f-43ad-4f8f-ac47-b52bef0073f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a4431c-2aa4-4b45-bd7a-21c2d42782fc', 'volume_name': 'volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d20ab43-3c50-4e87-937c-9765f76232fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d20ab43-3c50-4e87-937c-9765f76232fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3c9e30-4d48-4615-9c94-076408229ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Volume 16a4431c-2aa4-4b45-bd7a-21c2d42782fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc', 'volume_size': 1} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:21 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" returned: 0 in 1.176s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] <== create_volume: return (2885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.888s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-494688931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a4431c-2aa4-4b45-bd7a-21c2d42782fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721e7de1ad7417f8a623e6af27ad525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:21Z,use_quota=True,user_id='10321e1c8a3f4bdeb95b122943645217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Creating volume 16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:21 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:21 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc 1073741824 Jul 07 22:43:21 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6d838a-fe7e-498c-9bc9-c52d6f199736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3d308-ddd6-4229-a31c-6e172edcde64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:21 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Volume volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 (facab1dd-5cd8-4fbc-8058-3ab379b3ac08): created successfully Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3d308-ddd6-4229-a31c-6e172edcde64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Flow 'volume_create_manager' (a9615408-fcfd-44eb-aec4-3868a9cec2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3f34905d-87ad-45f0-9c70-abeb70954b53 tempest-VolumesSnapshotListTestJSON-1714566706 None] Created volume successfully. Jul 07 22:43:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:22 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c" returned: 0 in 1.061s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:22 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa Jul 07 22:43:22 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:22 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc 1073741824" returned: 0 in 1.126s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:22 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc Jul 07 22:43:22 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:23 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa" returned: 0 in 0.851s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:23 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa Jul 07 22:43:23 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:23 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" returned: 0 in 0.864s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.421s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3c9e30-4d48-4615-9c94-076408229ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce93ccb3-cf6e-4155-9fd7-b53407b14c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Creating offline snapshot 73629e4b-3109-4da3-ab84-a54d44c64575 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:23 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Volume volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc (16a4431c-2aa4-4b45-bd7a-21c2d42782fc): created successfully Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce93ccb3-cf6e-4155-9fd7-b53407b14c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Flow 'volume_create_manager' (0c5aeeb6-c2e5-4f8a-bfd4-866a0e2ce7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b40d0-c37b-4682-ba37-08d3176eba11]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8831ac9b-6df4-435a-a2a1-69a886472bf2 tempest-SnapshotMetadataTestJSON-632869631 None] Created volume successfully. Jul 07 22:43:23 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 Jul 07 22:43:23 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:24 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c.79bd1dc0-d710-4c65-8501-ffb9473697fa" returned: 0 in 0.893s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-79bd1dc0-d710-4c65-8501-ffb9473697fa" released by "_delete_snapshot" :: held 4.597s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" released by "delete_snapshot" :: held 4.639s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-a2c3dca3-1ea9-402b-9774-2010f986e6a5" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-a2c3dca3-1ea9-402b-9774-2010f986e6a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Deleting offline snapshot a2c3dca3-1ea9-402b-9774-2010f986e6a5 of volume 68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] snapshot_file for this snap is: volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ea84ee-d08f-4a00-803c-1e8bbf4e0259]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:24 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 Jul 07 22:43:24 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:24 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" returned: 0 in 0.998s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:24 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 1G Jul 07 22:43:24 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:25 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5" returned: 0 in 0.991s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d601df-c0a5-4b26-b842-256e7433133e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd698f78-2348-47fe-be6e-8bf3b82ebca9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:25 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e Jul 07 22:43:25 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:25 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 1G" returned: 0 in 0.945s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:25 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:25 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-8231d546-bd58-4151-b2ba-cc11e65a0eab req-5162578e-2e74-4b9b-8619-d9c232054431 tempest-TestInstancesWithCinderVolumes-1303876687 None] Terminate volume connection completed successfully. Jul 07 22:43:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-8231d546-bd58-4151-b2ba-cc11e65a0eab req-5162578e-2e74-4b9b-8619-d9c232054431 tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleting attachment 6405cd1f-fe22-4c67-8154-d2d94acf8c43. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:43:26 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:26 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 Jul 07 22:43:26 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:26 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:26 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 is being set with open permissions: ugo+rw Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:26 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:26 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:26 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5" returned: 0 in 0.803s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:26 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5 Jul 07 22:43:26 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:27 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 0.693s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:27 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info Jul 07 22:43:27 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:27 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e.a2c3dca3-1ea9-402b-9774-2010f986e6a5" returned: 0 in 0.663s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-a2c3dca3-1ea9-402b-9774-2010f986e6a5" released by "_delete_snapshot" :: held 3.405s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" released by "delete_snapshot" :: held 3.434s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:27 devstack cinder-volume[88087]: WARNING cinder.quota [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-107534656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-107534656, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:27 devstack cinder-volume[88087]: WARNING cinder.quota [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-107534656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-107534656, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Created reservations ['311d5345-ab94-4ddb-adc3-f73817cc65de', '0fdf5290-1550-444b-aa4c-9b4aa2992766', '5fcd89e6-10d5-4c4b-a5a3-f7b26b167fce', 'bffd8e43-e81b-42b8-8683-e99d35095914'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] Created reservations ['b4014890-6316-40de-bc6b-32fcad344d63', 'fdfd7d64-9e30-4f42-b9ff-b68f00950ade', 'b3185e45-af97-46d0-b8f7-3dcef42eb206', '3257d417-837f-4814-8aa4-e8c9a2d36033'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:27 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info" returned: 0 in 0.716s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:27 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info is being set with open permissions: ugo+rw Jul 07 22:43:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3584946b-2cc8-46f3-8935-6bf66dca4a4b tempest-GroupSnapshotsTest-358805566 None] group_snapshot f758b63e-c4e6-4e9e-ac5d-d35efd801d87: deleted successfully Jul 07 22:43:27 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info Jul 07 22:43:27 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:28 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.info" returned: 0 in 0.659s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.937s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.612s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Creating offline snapshot 61f1bf3c-0988-4698-b76a-387408faa67d of volume 16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7760cfe1-7b90-4b48-a270-a4ece1570ea3 tempest-VolumesSnapshotListTestJSON-1714566706 None] Create snapshot completed successfully Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da46fd-5e83-4027-8d21-910864412a84]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" acquired by "delete_volume" :: waited 0.059s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a7c9a-468e-4ddc-ab41-769d81f20f97]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:28 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc Jul 07 22:43:28 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:28 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c Jul 07 22:43:28 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-53a6cc76-9823-4852-9298-98ad34fe7da5-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-53a6cc76-9823-4852-9298-98ad34fe7da5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "cinder-quobyte-53a6cc76-9823-4852-9298-98ad34fe7da5" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-53a6cc76-9823-4852-9298-98ad34fe7da5" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b21736f-c276-4860-bbbd-7c4c02a2f05c]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:29 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:43:29 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:29 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:29 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d 1G Jul 07 22:43:29 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:29 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c" returned: 0 in 0.936s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:29 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c Jul 07 22:43:29 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:30 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 0.931s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:30 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:43:30 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:30 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-656be993-391e-489c-bcb8-6e364f8c737c" returned: 0 in 0.764s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-656be993-391e-489c-bcb8-6e364f8c737c" released by "delete_volume" :: held 1.779s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" acquired by "delete_volume" :: waited 0.013s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:30 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d 1G" returned: 0 in 0.955s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f0d59-1b35-4e99-ba11-bf0d8aa42c96]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:30 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d Jul 07 22:43:30 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:30 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e Jul 07 22:43:30 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:30 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 1 in 0.817s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:43:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:30 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5 Jul 07 22:43:30 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:31 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d" returned: 0 in 0.765s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:31 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d is being set with open permissions: ugo+rw Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:31 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d Jul 07 22:43:31 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:31 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e" returned: 0 in 0.833s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:31 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e Jul 07 22:43:31 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:31 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-53a6cc76-9823-4852-9298-98ad34fe7da5" returned: 0 in 0.700s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-quobyte-53a6cc76-9823-4852-9298-98ad34fe7da5" released by "delete_volume" :: held 2.535s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:31 devstack cinder-volume[88087]: WARNING cinder.quota [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1150656704-303217963 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1150656704-303217963, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:31 devstack cinder-volume[88087]: WARNING cinder.quota [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1150656704-303217963 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1150656704-303217963, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Created reservations ['5e502d44-9aa4-42fa-af9a-c45106f05213', '53ea189e-09ea-411d-8365-da7c82f2f378', 'e692a16c-4fb0-4ac4-a864-ae23128b0135', '2f352735-1359-4d78-96d0-4cc6f66a4028'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:31 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:31 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:32 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:32 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-68d601df-c0a5-4b26-b842-256e7433133e" returned: 0 in 0.663s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:32 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info Jul 07 22:43:32 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-68d601df-c0a5-4b26-b842-256e7433133e" released by "delete_volume" :: held 1.570s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Created reservations ['b214a83d-18cb-4585-bf99-4c10fff68333'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:32 devstack cinder-volume[88087]: WARNING cinder.quota [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-107534656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-107534656, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Created reservations ['88252443-e224-4080-8b00-f9b17591b322', '2ec79f10-54a4-421d-81b4-d8c237096d3e', '98edc799-ac1a-42a6-b7fc-59eec56fceda', '10a0ceba-aaf0-4e26-9341-abe3176fddb1'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Created reservations ['14d48bb6-0946-448f-a784-f731025e3a87', 'a7c1cbf9-7805-4852-b841-bf907c45ec4f', 'c47f196b-761b-43de-9727-b8975ea6a548', 'cb1b9bbd-bd00-4e71-a56d-923f23245264'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:32 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.714s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:32 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Deleted volume successfully. Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0a5070a9-6083-4c04-81a0-b46c9c515918 tempest-TestInstancesWithCinderVolumes-1303876687 None] Lock "cinder-53a6cc76-9823-4852-9298-98ad34fe7da5-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:32 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:32 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:32 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info is being set with open permissions: ugo+rw Jul 07 22:43:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:32 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info Jul 07 22:43:32 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:33 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.702s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-79cbe392-b656-4816-942d-92191df992ec tempest-GroupSnapshotsTest-358805566 None] Delete group completed successfully. Jul 07 22:43:33 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.info" returned: 0 in 0.706s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.946s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.714s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Creating offline snapshot bcbe4614-d69d-411d-96f1-d64aaca1c890 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-26296763-780d-4536-8c0d-bf749563f362 tempest-SnapshotMetadataTestJSON-632869631 None] Create snapshot completed successfully Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e031b-55e4-4710-b28f-bbade67469a6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:33 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:33 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1b6be77c-bbeb-4a09-944d-28aacc1cd6d2 tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-1469328424: creating Jul 07 22:43:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1b6be77c-bbeb-4a09-944d-28aacc1cd6d2 tempest-GroupSnapshotsTest-358805566 None] Group tempest-GroupSnapshotsTest-Group-1469328424: created successfully Jul 07 22:43:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1b6be77c-bbeb-4a09-944d-28aacc1cd6d2 tempest-GroupSnapshotsTest-358805566 None] Create group completed successfully. Jul 07 22:43:34 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 0.891s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:34 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 1G Jul 07 22:43:34 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "cinder-61f1bf3c-0988-4698-b76a-387408faa67d-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-61f1bf3c-0988-4698-b76a-387408faa67d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "cinder-quobyte-61f1bf3c-0988-4698-b76a-387408faa67d" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-61f1bf3c-0988-4698-b76a-387408faa67d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Deleting offline snapshot 61f1bf3c-0988-4698-b76a-387408faa67d of volume 16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] snapshot_file for this snap is: volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a4713-86bd-4092-8870-fe14546aba59]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:35 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d Jul 07 22:43:35 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:35 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 1G" returned: 0 in 1.145s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:43:35 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:35 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (f53c5570-45c6-4633-8d78-93ebae595fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe53db6f-2a55-4125-aeee-3a152fcbd1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe53db6f-2a55-4125-aeee-3a152fcbd1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533928996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b96628c8-8a9b-42c3-925c-ae22a9057d68,host='devstack@QuobyteHD#QuobyteHD',id=e9e6dd95-c036-4773-8a8f-c2fc6807e775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:36Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92934839-68d8-4748-8db6-65bd2259ccf2),volume_type_id=92934839-68d8-4748-8db6-65bd2259ccf2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a2dd9-89c6-4019-86bf-b601dbdc9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a2dd9-89c6-4019-86bf-b601dbdc9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391b1445-36c6-4fd7-9293-e26384a98526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391b1445-36c6-4fd7-9293-e26384a98526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e6dd95-c036-4773-8a8f-c2fc6807e775', 'volume_name': 'volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e1fe18-f785-4b81-988d-9758177e00c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e1fe18-f785-4b81-988d-9758177e00c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c4e2de-c972-4f6c-869a-5ce35c90120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Volume e9e6dd95-c036-4773-8a8f-c2fc6807e775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775', 'volume_size': 1} Jul 07 22:43:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:36 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d816e7-64d4-4387-b897-0cac55d43c11]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:36 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc Jul 07 22:43:36 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:36 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.967s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:36 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 is being set with open permissions: ugo+rw Jul 07 22:43:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:36 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:36 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:37 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" returned: 0 in 0.951s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:37 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d Jul 07 22:43:37 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:37 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.908s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b96628c8-8a9b-42c3-925c-ae22a9057d68,created_at=2026-07-07T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533928996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b96628c8-8a9b-42c3-925c-ae22a9057d68,host='devstack@QuobyteHD#QuobyteHD',id=e9e6dd95-c036-4773-8a8f-c2fc6807e775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e813385a8d947a6876cf2d886ec11b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:36Z,use_quota=True,user_id='754d963435564b3397b13cc4fe8c079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92934839-68d8-4748-8db6-65bd2259ccf2),volume_type_id=92934839-68d8-4748-8db6-65bd2259ccf2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Creating volume e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:37 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:43:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:37 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 1073741824 Jul 07 22:43:37 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-db8748dd-636f-4291-ba53-982a728f740f tempest-VolumesSnapshotListTestJSON-1714566706 None] Create snapshot completed successfully Jul 07 22:43:38 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d" returned: 0 in 0.885s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:38 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d Jul 07 22:43:38 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:38 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 1073741824" returned: 0 in 1.053s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:38 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 Jul 07 22:43:38 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:38 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc.61f1bf3c-0988-4698-b76a-387408faa67d" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-61f1bf3c-0988-4698-b76a-387408faa67d" released by "_delete_snapshot" :: held 3.626s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" released by "delete_snapshot" :: held 3.660s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Created reservations ['4a3cb13b-79b9-4830-8dac-c009df81e2d1', 'c9b8df3c-bd41-4f7f-bc9d-bec5b0cc099a', '47e632ac-db44-4e70-b502-7df8b2aa2f1b', 'a49c40ef-2487-4959-8fbd-840e5ea85e38'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Delete snapshot completed successfully. Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-392477ce-286a-482b-9563-8b5a818d3245 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-61f1bf3c-0988-4698-b76a-387408faa67d-delete_snapshot" released by "delete_snapshot" :: held 3.834s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:39 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775" returned: 0 in 0.723s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.730s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c4e2de-c972-4f6c-869a-5ce35c90120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e710caf-6fa9-418e-89cc-dcbf93a02ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Creating offline snapshot f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:39 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Volume volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 (e9e6dd95-c036-4773-8a8f-c2fc6807e775): created successfully Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e710caf-6fa9-418e-89cc-dcbf93a02ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Flow 'volume_create_manager' (f53c5570-45c6-4633-8d78-93ebae595fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea584d-a56c-4d4a-a2a8-d9f6cb83dc82]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1e395df7-7c61-47f6-9f4c-95fa95cc8bff tempest-GroupSnapshotsTest-358805566 None] Created volume successfully. Jul 07 22:43:39 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:39 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "cinder-16a4431c-2aa4-4b45-bd7a-21c2d42782fc-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-16a4431c-2aa4-4b45-bd7a-21c2d42782fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d72a11-ee47-4112-a76d-36a0b05a77bf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:39 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc Jul 07 22:43:39 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:40 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:40 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 1G Jul 07 22:43:40 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:40 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" returned: 0 in 0.985s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:40 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc Jul 07 22:43:40 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] GroupSnapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: creating. Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Group snapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: creating. {{(pid=88087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:43:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:41 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 1G" returned: 0 in 1.088s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:41 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 Jul 07 22:43:41 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:41 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" returned: 0 in 0.805s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-quobyte-16a4431c-2aa4-4b45-bd7a-21c2d42782fc" released by "delete_volume" :: held 1.876s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Created reservations ['ff42cd0e-bf62-4fdb-b21b-59a37b06d7b6', '9724b796-b381-4955-b405-42c312770636', '8098367d-8307-4b4d-bdf7-c468e61e9d1a', '0620364c-7658-4e43-84a4-a6ae28e37fb5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:41 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:41 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:42 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" returned: 0 in 0.887s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:42 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 is being set with open permissions: ugo+rw Jul 07 22:43:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:42 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 Jul 07 22:43:42 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:42 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.827s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:42 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:42 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Deleted volume successfully. Jul 07 22:43:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13d1d108-3e30-4b8f-b6bf-40f2ddad2451 tempest-SnapshotMetadataTestJSON-632869631 None] Lock "cinder-16a4431c-2aa4-4b45-bd7a-21c2d42782fc-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:43 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" returned: 0 in 0.865s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.825s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.238s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Creating offline snapshot f5dc36ac-faaa-4f69-b97c-3ecac35214ad of volume e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f76aff-b94b-4884-ade4-632b62fc2f24]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-03320cce-b170-45a4-a045-565f4a00660c tempest-VolumesSnapshotListTestJSON-1714566706 None] Create snapshot completed successfully Jul 07 22:43:43 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 Jul 07 22:43:43 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:44 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:44 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad 1G Jul 07 22:43:44 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Deleting offline snapshot f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] snapshot_file for this snap is: volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d3ff2b-ad36-43fe-b537-76053da3ba55]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:45 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 Jul 07 22:43:45 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:45 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad 1G" returned: 0 in 1.113s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:45 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad Jul 07 22:43:45 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:46 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" returned: 0 in 0.973s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7559f21-2b29-401e-b9da-64ac4fb14f03]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (69945100-d186-48b5-84f9-7b08d22d1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574cbd0f-6907-4253-a6f9-0c15e2f55eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:46 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:46 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574cbd0f-6907-4253-a6f9-0c15e2f55eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-18360662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2315b5d7-b182-4718-86aa-6c62250c94d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0784e64378b4fb7ae76d8734d9d3c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:46Z,use_quota=True,user_id='15ba70dec4544abca4a36b688d8dc40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae8f11-d238-4337-aa43-a0b0c3c5412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae8f11-d238-4337-aa43-a0b0c3c5412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81dee61-6382-4da1-a0d6-737a5a2624f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81dee61-6382-4da1-a0d6-737a5a2624f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2315b5d7-b182-4718-86aa-6c62250c94d1', 'volume_name': 'volume-2315b5d7-b182-4718-86aa-6c62250c94d1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1fbb3-8aab-4714-928b-479b637fa9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:46 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1fbb3-8aab-4714-928b-479b637fa9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181371f0-5e55-4e8e-99d9-d2f4f0265d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:46 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Volume 2315b5d7-b182-4718-86aa-6c62250c94d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2315b5d7-b182-4718-86aa-6c62250c94d1', 'volume_size': 1} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad" returned: 0 in 1.104s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:46 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:46 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad Jul 07 22:43:46 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:47 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.991s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:47 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 Jul 07 22:43:47 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:47 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:47 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info Jul 07 22:43:47 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:47 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info" returned: 0 in 0.681s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:47 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:43:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:47 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info Jul 07 22:43:48 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:48 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" returned: 0 in 0.937s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:48 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2 Jul 07 22:43:48 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:48 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.info" returned: 0 in 0.716s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.528s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.271s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-18360662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2315b5d7-b182-4718-86aa-6c62250c94d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0784e64378b4fb7ae76d8734d9d3c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:46Z,use_quota=True,user_id='15ba70dec4544abca4a36b688d8dc40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Creating volume 2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:48 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:48 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 1073741824 Jul 07 22:43:48 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:48 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-741b9304-2bd6-45d4-a9b8-2e8a88ac5b00 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: created successfully Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2" released by "_delete_snapshot" :: held 3.750s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" released by "delete_snapshot" :: held 3.789s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:48 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Created reservations ['c4ef54ea-e453-45cb-96c6-537f50c87e29', '8823fb72-49f8-4a85-a935-301ff13f4a83', '23d5dfcb-c14e-4156-8adc-b136826c783f', '8f61ece4-55a1-4369-855a-bbfe996a14ef'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Delete snapshot completed successfully. Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8e35adb6-fb21-4252-a828-52b333158b69 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-f079f4ca-cc30-4c9e-b58d-910dcc45ebb2-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-bcbe4614-d69d-411d-96f1-d64aaca1c890-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-bcbe4614-d69d-411d-96f1-d64aaca1c890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-bcbe4614-d69d-411d-96f1-d64aaca1c890" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-bcbe4614-d69d-411d-96f1-d64aaca1c890" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Deleting offline snapshot bcbe4614-d69d-411d-96f1-d64aaca1c890 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] snapshot_file for this snap is: volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d84d2e-2b72-4562-a00b-710f387c3d50]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:49 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:49 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: deleting Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: deleting {{(pid=88087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-f5dc36ac-faaa-4f69-b97c-3ecac35214ad" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:49 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 1073741824" returned: 0 in 1.151s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-f5dc36ac-faaa-4f69-b97c-3ecac35214ad" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Deleting offline snapshot f5dc36ac-faaa-4f69-b97c-3ecac35214ad of volume e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] snapshot_file for this snap is: volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[231baddd-89e8-4162-a53c-d8cc8cc1dd9c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:50 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:43:50 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:50 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad Jul 07 22:43:50 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:50 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.916s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[956e974c-2c4f-484b-ad8e-1b26f434556b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:50 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:50 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:50 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 0.753s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181371f0-5e55-4e8e-99d9-d2f4f0265d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2315b5d7-b182-4718-86aa-6c62250c94d1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74432fa5-bb4f-4308-92c7-736c4d538d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:50 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Volume volume-2315b5d7-b182-4718-86aa-6c62250c94d1 (2315b5d7-b182-4718-86aa-6c62250c94d1): created successfully Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74432fa5-bb4f-4308-92c7-736c4d538d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (69945100-d186-48b5-84f9-7b08d22d1f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5e930a98-243a-4f72-b99e-a5abf1afff5e tempest-VolumesDeleteCascade-1851582135 None] Created volume successfully. Jul 07 22:43:50 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad" returned: 0 in 0.938s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ef8c8-b778-4800-8181-91c9d87e128d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:51 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 Jul 07 22:43:51 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:51 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 0.960s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:51 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:51 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Creating offline snapshot 3c193ba7-36db-4b3f-b1ef-9681b2646e8e of volume 2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:52 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775" returned: 0 in 1.141s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1ab1b-4c5e-4af3-b450-9bafa9aaf695]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:52 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad Jul 07 22:43:52 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:52 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:43:52 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:52 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 1.149s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:52 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890 Jul 07 22:43:52 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:52 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:52 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e 1G Jul 07 22:43:52 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:53 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad" returned: 0 in 1.053s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:53 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad Jul 07 22:43:53 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:53 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.bcbe4614-d69d-411d-96f1-d64aaca1c890" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-bcbe4614-d69d-411d-96f1-d64aaca1c890" released by "_delete_snapshot" :: held 3.976s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" released by "delete_snapshot" :: held 4.013s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Created reservations ['58d06956-1132-4d02-9313-69309f689e62', '46f056d1-a00e-480c-99be-0a2dd0d3f347', '81d979c4-93d0-4456-9fa0-2194d962dcb5', 'fb894afe-e63b-455e-ac47-0feb1727ada8'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Delete snapshot completed successfully. Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dedef449-8be6-435c-8c19-2b4b13cd56da tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-bcbe4614-d69d-411d-96f1-d64aaca1c890-delete_snapshot" released by "delete_snapshot" :: held 4.244s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-73629e4b-3109-4da3-ab84-a54d44c64575-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-73629e4b-3109-4da3-ab84-a54d44c64575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-73629e4b-3109-4da3-ab84-a54d44c64575" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-73629e4b-3109-4da3-ab84-a54d44c64575" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Deleting offline snapshot 73629e4b-3109-4da3-ab84-a54d44c64575 of volume facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] snapshot_file for this snap is: volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caeb169-929a-46fc-8e86-340f8cbbdacf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:53 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:54 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:54 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775.f5dc36ac-faaa-4f69-b97c-3ecac35214ad" returned: 0 in 1.005s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-f5dc36ac-faaa-4f69-b97c-3ecac35214ad" released by "_delete_snapshot" :: held 4.273s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" released by "delete_snapshot" :: held 4.305s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:54 devstack cinder-volume[88087]: WARNING cinder.quota [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1783423323 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1783423323, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:54 devstack cinder-volume[88087]: WARNING cinder.quota [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1783423323 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1783423323, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:54 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e 1G" returned: 0 in 1.304s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] Created reservations ['12917fc3-22f1-4549-9bf9-4271e62d9b2c', 'fc49a5d8-4073-41e9-b03f-36c7e5e464c4', '1bf9c0f7-eb1b-49a2-aeee-b170510fcd8d', 'bcca2e24-9b0c-4b61-99b1-48799e57a15b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:54 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:43:54 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-776a1882-22a7-426f-9e04-ff7d4b12bae2 tempest-GroupSnapshotsTest-358805566 None] group_snapshot 2a99afaa-10e1-469f-8cc3-0fef483c67f6: deleted successfully Jul 07 22:43:54 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 1.012s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ff2a5-f603-459a-9757-693a43c06ad9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:54 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 Jul 07 22:43:54 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:55 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:55 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e is being set with open permissions: ugo+rw Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:55 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:43:55 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:55 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" returned: 0 in 0.904s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:55 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:55 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[807be5e9-bbf0-4947-911b-c54b246a85dd]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:55 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:56 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info Jul 07 22:43:56 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:56 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 Jul 07 22:43:56 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:56 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 1.117s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:56 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:56 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info is being set with open permissions: ugo+rw Jul 07 22:43:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:56 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575 Jul 07 22:43:56 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:56 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info Jul 07 22:43:56 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:57 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775" returned: 0 in 1.309s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:57 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775 Jul 07 22:43:57 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:57 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.info" returned: 0 in 0.949s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.877s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3de1061b-b066-4c00-ad23-55677ab8b3ec tempest-VolumesDeleteCascade-1851582135 None] Create snapshot completed successfully Jul 07 22:43:57 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08.73629e4b-3109-4da3-ab84-a54d44c64575" returned: 0 in 1.100s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-73629e4b-3109-4da3-ab84-a54d44c64575" released by "_delete_snapshot" :: held 4.290s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" released by "delete_snapshot" :: held 4.318s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:58 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e9e6dd95-c036-4773-8a8f-c2fc6807e775" returned: 0 in 0.860s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Lock "cinder-quobyte-e9e6dd95-c036-4773-8a8f-c2fc6807e775" released by "delete_volume" :: held 2.268s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Created reservations ['928f3714-57b4-4922-a90d-9828a9de3dcd', 'fb11e741-1841-44c5-97a7-88fb1804b4cb', '03c17e4a-0cfc-4fb5-b93e-291a0b1ede22', '9de2a924-3fb3-4746-9320-6076ec874437'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Delete snapshot completed successfully. Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4689a818-3203-4f8f-ac38-61db5577df41 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-73629e4b-3109-4da3-ab84-a54d44c64575-delete_snapshot" released by "delete_snapshot" :: held 4.522s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Created reservations ['07d16e4f-6f85-496c-bc38-4a989127ff72'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:58 devstack cinder-volume[88087]: WARNING cinder.quota [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1783423323 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1783423323, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Created reservations ['38dc49c4-889d-48f2-8444-937a01694651', '6af9db99-ec07-4a4c-86bb-9af4431a886a', '4b971369-f00b-43be-b1b6-8b36128711ef', '71ad41af-8c23-4ae1-a9ee-0ac7d6957c8f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:58 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:43:58 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Creating offline snapshot e82e6e06-cf6f-47ea-a787-fc0155d2146f of volume 2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4cf897-408e-42d4-9a27-1e025a5db5cd]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:58 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:43:58 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-facab1dd-5cd8-4fbc-8058-3ab379b3ac08-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:59 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-facab1dd-5cd8-4fbc-8058-3ab379b3ac08-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.820s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5ee98f64-5dc7-4ab7-9b72-9af9921b781f tempest-GroupSnapshotsTest-358805566 None] Delete group completed successfully. Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8d91fe-89c3-4a90-9751-2b203e076da4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:59 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 Jul 07 22:43:59 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:59 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 0.944s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2315b5d7-b182-4718-86aa-6c62250c94d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:59 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f 1G Jul 07 22:43:59 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:00 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" returned: 0 in 0.929s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:00 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08 Jul 07 22:44:00 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:00 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f 1G" returned: 0 in 1.251s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:00 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:00 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:01 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" returned: 0 in 0.894s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-quobyte-facab1dd-5cd8-4fbc-8058-3ab379b3ac08" released by "delete_volume" :: held 1.886s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=158,cinder:INSERT=44,cinder:UPDATE=176,cinder:DELETE=11 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Created reservations ['376dc4ad-3df2-4ef1-a5e1-75df14bd9761', '8082ab83-8b00-43f9-b001-cd8da56fab80', '4449df7c-17ba-4ba1-bad6-cb358b4bb41e', 'c27fe209-34a5-4013-bf22-8f79cfbc6f19'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:01 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:01 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:01 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 1.014s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:01 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f is being set with open permissions: ugo+rw Jul 07 22:44:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:01 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:01 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:02 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.011s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Deleted volume successfully. Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fa7aa67b-2940-4d14-a3d2-e973ce532887 tempest-VolumesSnapshotListTestJSON-1714566706 None] Lock "cinder-facab1dd-5cd8-4fbc-8058-3ab379b3ac08-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:02 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.160s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f092de49-d5a1-4870-9022-2f6297fc94b6 tempest-VolumesDeleteCascade-1851582135 None] Create snapshot completed successfully Jul 07 22:44:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-2315b5d7-b182-4718-86aa-6c62250c94d1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-2315b5d7-b182-4718-86aa-6c62250c94d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Performing cascade delete. {{(pid=88087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-3c193ba7-36db-4b3f-b1ef-9681b2646e8e-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-3c193ba7-36db-4b3f-b1ef-9681b2646e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-3c193ba7-36db-4b3f-b1ef-9681b2646e8e" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-3c193ba7-36db-4b3f-b1ef-9681b2646e8e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Deleting offline snapshot 3c193ba7-36db-4b3f-b1ef-9681b2646e8e of volume 2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] snapshot_file for this snap is: volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70a566-e1e1-48e0-8f0b-0b7ca04a0c9e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:03 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:44:03 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:04 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2315b5d7-b182-4718-86aa-6c62250c94d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f94b4-09bd-4181-8e8e-b27828f5c193]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:04 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:44:04 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:05 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 1.098s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:05 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[431057ee-34ea-441d-a7ca-d1e82a71831e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:05 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:05 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:06 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 0.953s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2315b5d7-b182-4718-86aa-6c62250c94d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:06 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e7b42-c0d4-46d5-bee3-ea8abd77b9fb]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:06 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:44:06 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:07 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 1.145s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2315b5d7-b182-4718-86aa-6c62250c94d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e8073-a4d7-4fcb-b8a3-58ea63f2ff81]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:07 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:44:07 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:08 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 1.025s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:08 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:44:08 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:09 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 1.078s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:09 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e Jul 07 22:44:09 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:10 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.3c193ba7-36db-4b3f-b1ef-9681b2646e8e" returned: 0 in 0.893s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f -F qcow2 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:10 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f -F qcow2 Jul 07 22:44:10 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:11 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2315b5d7-b182-4718-86aa-6c62250c94d1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f -F qcow2" returned: 0 in 0.891s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-3c193ba7-36db-4b3f-b1ef-9681b2646e8e" released by "_delete_snapshot" :: held 8.253s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" released by "delete_snapshot" :: held 8.287s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=146,cinder:SELECT=141,cinder:INSERT=36,cinder:DELETE=7 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['536aff02-0090-4bc0-a9d0-3213139d59a9', '84adf52e-7ce3-452b-a12a-55310412f87e', 'fc28ec60-2e84-4c44-bb0d-fd0748da9da1', '810608eb-0822-4545-81f6-74fd10fbe934'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Delete snapshot completed successfully. Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-3c193ba7-36db-4b3f-b1ef-9681b2646e8e-delete_snapshot" released by "delete_snapshot" :: held 8.518s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-e82e6e06-cf6f-47ea-a787-fc0155d2146f-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-e82e6e06-cf6f-47ea-a787-fc0155d2146f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-e82e6e06-cf6f-47ea-a787-fc0155d2146f" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-e82e6e06-cf6f-47ea-a787-fc0155d2146f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Deleting offline snapshot e82e6e06-cf6f-47ea-a787-fc0155d2146f of volume 2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] snapshot_file for this snap is: volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2af4d63-c0e7-424e-9580-d8bad8129928]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:12 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:12 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:12 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 1.144s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2315b5d7-b182-4718-86aa-6c62250c94d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d3cba-08d7-4747-befa-f72d610c00be]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:13 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:44:13 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:13 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 0.942s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:14 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:14 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:15 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 1.241s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:15 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f Jul 07 22:44:15 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:15 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:15 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:16 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1.e82e6e06-cf6f-47ea-a787-fc0155d2146f" returned: 0 in 0.836s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-e82e6e06-cf6f-47ea-a787-fc0155d2146f" released by "_delete_snapshot" :: held 4.337s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" released by "delete_snapshot" :: held 4.381s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['22d49dcc-b7b2-435e-b107-cb091b8f7c5c', '4ca2b330-5723-46af-b46f-54c0a480328e', '7bfc04af-007d-4dab-8d12-bdeedc49914c', '47310321-17bb-464f-97f4-6cc4c6f83b10'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Delete snapshot completed successfully. Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-e82e6e06-cf6f-47ea-a787-fc0155d2146f-delete_snapshot" released by "delete_snapshot" :: held 4.667s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Snapshots deleted, issuing volume delete {{(pid=88087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" acquired by "delete_volume" :: waited 0.046s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e928b0c-6505-4714-8e44-c9f9ee133580]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f2bcd816-75e5-4167-875b-8bd0e766afeb tempest-GroupsTest-1475662796 None] Group tempest-Group1-306807362: creating Jul 07 22:44:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f2bcd816-75e5-4167-875b-8bd0e766afeb tempest-GroupsTest-1475662796 None] Group tempest-Group1-306807362: created successfully Jul 07 22:44:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f2bcd816-75e5-4167-875b-8bd0e766afeb tempest-GroupsTest-1475662796 None] Create group completed successfully. Jul 07 22:44:16 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:44:16 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:16 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.151s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:44:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:44:17 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 1.039s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:17 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1 Jul 07 22:44:17 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c094d570-3169-4d5e-8624-eef1e1176c3d tempest-GroupsTest-1475662796 None] Group tempest-Group2-1514557023: creating Jul 07 22:44:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c094d570-3169-4d5e-8624-eef1e1176c3d tempest-GroupsTest-1475662796 None] Group tempest-Group2-1514557023: created successfully Jul 07 22:44:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c094d570-3169-4d5e-8624-eef1e1176c3d tempest-GroupsTest-1475662796 None] Create group completed successfully. Jul 07 22:44:18 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2315b5d7-b182-4718-86aa-6c62250c94d1" returned: 0 in 1.032s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-2315b5d7-b182-4718-86aa-6c62250c94d1" released by "delete_volume" :: held 2.185s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['32dc9947-2633-417b-b1b9-6c1752a4b172', 'd4c19564-a06e-42b2-a8c3-bcf0a08c9d1b', 'b841a398-5b86-4133-bce3-ff128933e8dd', '31813d93-77d9-4680-b5eb-62c5706d40aa'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:18 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:18 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:19 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Deleted volume successfully. Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5a49dd5c-da3f-4e92-82eb-201336090f94 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-2315b5d7-b182-4718-86aa-6c62250c94d1-delete_volume" released by "delete_volume" :: held 16.590s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (6c3be475-23e3-4742-bd26-1869f08ba91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0576601f-cef7-4ba3-b5d6-2f3756d7c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0576601f-cef7-4ba3-b5d6-2f3756d7c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575266640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a5ffc4-50ed-4a16-bb7a-093f5a98fb7c,host='devstack@QuobyteHD#QuobyteHD',id=7c4bc196-66b3-4f41-842d-e004fee0cd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:20Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91db371-34d4-4149-abe4-049bb4c194a9),volume_type_id=b91db371-34d4-4149-abe4-049bb4c194a9)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eac097-3cf7-4e66-a130-0734821153fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eac097-3cf7-4e66-a130-0734821153fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388829da-5f62-477d-b26d-535c2906451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388829da-5f62-477d-b26d-535c2906451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4bc196-66b3-4f41-842d-e004fee0cd84', 'volume_name': 'volume-7c4bc196-66b3-4f41-842d-e004fee0cd84', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed098d-597f-4b0d-af0d-1118d660f0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed098d-597f-4b0d-af0d-1118d660f0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750b33fe-43ae-4acd-a378-0671bf52a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Volume 7c4bc196-66b3-4f41-842d-e004fee0cd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4bc196-66b3-4f41-842d-e004fee0cd84', 'volume_size': 1} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a5ffc4-50ed-4a16-bb7a-093f5a98fb7c,created_at=2026-07-07T20:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575266640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a5ffc4-50ed-4a16-bb7a-093f5a98fb7c,host='devstack@QuobyteHD#QuobyteHD',id=7c4bc196-66b3-4f41-842d-e004fee0cd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:20Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91db371-34d4-4149-abe4-049bb4c194a9),volume_type_id=b91db371-34d4-4149-abe4-049bb4c194a9)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Creating volume 7c4bc196-66b3-4f41-842d-e004fee0cd84 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:19 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:19 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 1073741824 Jul 07 22:44:19 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (46bfa4c7-0816-44e1-b2a7-32f6969d65f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34371865-d88e-4f67-acbd-bd8d8e4ebf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34371865-d88e-4f67-acbd-bd8d8e4ebf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1528548730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0784e64378b4fb7ae76d8734d9d3c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:21Z,use_quota=True,user_id='15ba70dec4544abca4a36b688d8dc40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ea4d2b-e15a-4664-9ee4-68b069d8381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ea4d2b-e15a-4664-9ee4-68b069d8381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af58177b-31d6-4120-8c35-3060ed3b7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af58177b-31d6-4120-8c35-3060ed3b7323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d', 'volume_name': 'volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8002e90-b881-4b35-a24c-d1e6fecf2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8002e90-b881-4b35-a24c-d1e6fecf2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3823d7f9-e139-4c8f-b7c3-9d7767a90012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:20 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Volume 9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d', 'volume_size': 1} Jul 07 22:44:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:21 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 1073741824" returned: 0 in 1.132s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:21 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 Jul 07 22:44:21 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:21 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1528548730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0784e64378b4fb7ae76d8734d9d3c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:21Z,use_quota=True,user_id='15ba70dec4544abca4a36b688d8dc40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Creating volume 9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:21 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750b33fe-43ae-4acd-a378-0671bf52a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4bc196-66b3-4f41-842d-e004fee0cd84', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebd295d-337b-44e7-aafd-b80af1bceaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:21 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d 1073741824 Jul 07 22:44:21 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:21 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Volume volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 (7c4bc196-66b3-4f41-842d-e004fee0cd84): created successfully Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebd295d-337b-44e7-aafd-b80af1bceaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (6c3be475-23e3-4742-bd26-1869f08ba91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b3136e7d-e32c-4248-a48d-6d90ace14ee6 tempest-GroupsTest-1475662796 None] Created volume successfully. Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Acquiring lock "cinder-quobyte-7c4bc196-66b3-4f41-842d-e004fee0cd84" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-7c4bc196-66b3-4f41-842d-e004fee0cd84" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ccfd0-012f-4314-a2f9-a4006c8e6ebc]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:23 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d 1073741824" returned: 0 in 1.264s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:23 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:23 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:23 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 Jul 07 22:44:23 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:24 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84" returned: 0 in 1.275s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:24 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84 Jul 07 22:44:24 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:24 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 1.296s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.640s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3823d7f9-e139-4c8f-b7c3-9d7767a90012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe1746d-4810-44bd-a904-2a0091438c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:24 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Volume volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d (9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d): created successfully Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe1746d-4810-44bd-a904-2a0091438c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (46bfa4c7-0816-44e1-b2a7-32f6969d65f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-71914d62-d128-4e36-9578-510bfdf32d91 tempest-VolumesDeleteCascade-1851582135 None] Created volume successfully. Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Creating offline snapshot 678d3686-a43c-475e-ba1e-061cf311f88b of volume 9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f15e283-4848-40d6-a4b9-5101512345d9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:25 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7c4bc196-66b3-4f41-842d-e004fee0cd84" returned: 0 in 0.993s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-7c4bc196-66b3-4f41-842d-e004fee0cd84" released by "delete_volume" :: held 2.332s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:25 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:25 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Created reservations ['30f81727-bcc5-4cef-bd7b-af1600687152'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:25 devstack cinder-volume[88087]: WARNING cinder.quota [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-220586924 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-220586924, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:25 devstack cinder-volume[88087]: WARNING cinder.quota [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-220586924 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-220586924, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Created reservations ['5124ce88-0490-4423-9962-d54c9041db1b', '1f1a3df0-278b-4f7c-8146-605f4619b51e', '2852d2ce-725f-4447-97c2-55adca8c38da', 'c65be8f3-7627-47cf-b106-9e1fc61ce176'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:25 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:25 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:26 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 1.190s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:26 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b 1G Jul 07 22:44:26 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:26 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.817s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:26 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-829067da-01e6-4117-a7b9-360fc10855e5 tempest-GroupsTest-1475662796 None] Delete group completed successfully. Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Created reservations ['26675028-ec69-46b1-8af3-61e6ec537091'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:27 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:27 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:27 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b 1G" returned: 0 in 1.251s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:27 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:27 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:27 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.745s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:27 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-421f6318-e33d-4c31-9521-b3c1a4d9366b tempest-GroupsTest-1475662796 None] Delete group completed successfully. Jul 07 22:44:28 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 0.845s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:28 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b is being set with open permissions: ugo+rw Jul 07 22:44:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:28 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:28 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7c433fa3-a569-4268-825c-e4b20ce5c890 tempest-GroupsTest-1475662796 None] Group tempest-GroupsTest-Group-1796883054: creating Jul 07 22:44:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7c433fa3-a569-4268-825c-e4b20ce5c890 tempest-GroupsTest-1475662796 None] Group tempest-GroupsTest-Group-1796883054: created successfully Jul 07 22:44:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7c433fa3-a569-4268-825c-e4b20ce5c890 tempest-GroupsTest-1475662796 None] Create group completed successfully. Jul 07 22:44:29 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 0.804s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:29 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info Jul 07 22:44:29 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:30 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:30 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info is being set with open permissions: ugo+rw Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:30 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info Jul 07 22:44:30 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (4f4c6828-03f0-4b96-93c3-9fbba4b3dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358f4962-53ec-424a-8e83-02bd7b43c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358f4962-53ec-424a-8e83-02bd7b43c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27604478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,host='devstack@QuobyteHD#QuobyteHD',id=f3e622e3-105e-4f4e-839d-c3a546e70a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:31Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9970110-2203-48e4-afa5-829553338342),volume_type_id=b9970110-2203-48e4-afa5-829553338342)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f7f8f8-e218-4d02-a3c2-f0805cc70e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f7f8f8-e218-4d02-a3c2-f0805cc70e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b53ea82-bdc4-408b-adb9-9dc88776204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b53ea82-bdc4-408b-adb9-9dc88776204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e622e3-105e-4f4e-839d-c3a546e70a8d', 'volume_name': 'volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4c5e48-c227-4142-900f-6c17ae1f71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4c5e48-c227-4142-900f-6c17ae1f71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1bd2e4-16f8-47c1-9fe8-106d11be8f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:30 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Volume f3e622e3-105e-4f4e-839d-c3a546e70a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d', 'volume_size': 1} Jul 07 22:44:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:31 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.info" returned: 0 in 0.824s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.914s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,created_at=2026-07-07T20:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27604478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,host='devstack@QuobyteHD#QuobyteHD',id=f3e622e3-105e-4f4e-839d-c3a546e70a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:31Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9970110-2203-48e4-afa5-829553338342),volume_type_id=b9970110-2203-48e4-afa5-829553338342)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Creating volume f3e622e3-105e-4f4e-839d-c3a546e70a8d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:31 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c9c5b631-ab47-467a-b353-6906a599a245 tempest-VolumesDeleteCascade-1851582135 None] Create snapshot completed successfully Jul 07 22:44:31 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d 1073741824 Jul 07 22:44:31 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:32 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d 1073741824" returned: 0 in 1.491s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (659a0f8f-63c3-45a8-9376-9d198442a1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad38a988-a59f-4b9a-b543-fb69640d7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad38a988-a59f-4b9a-b543-fb69640d7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1305235585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038fa89-1900-4e35-bdf6-b66a40abfb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0784e64378b4fb7ae76d8734d9d3c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=678d3686-a43c-475e-ba1e-061cf311f88b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:33Z,use_quota=True,user_id='15ba70dec4544abca4a36b688d8dc40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c583b4ec-578f-49a9-8db9-5ba6d72d1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c583b4ec-578f-49a9-8db9-5ba6d72d1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51befa7-80d0-4978-98f3-cbeda5190a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51befa7-80d0-4978-98f3-cbeda5190a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1038fa89-1900-4e35-bdf6-b66a40abfb44', 'volume_name': 'volume-1038fa89-1900-4e35-bdf6-b66a40abfb44', 'volume_size': 1, 'snapshot_id': '678d3686-a43c-475e-ba1e-061cf311f88b'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897a6c45-d4bc-4282-95b6-36a0b47a6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897a6c45-d4bc-4282-95b6-36a0b47a6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba257f5-e9eb-44eb-976f-f199785f62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Volume 1038fa89-1900-4e35-bdf6-b66a40abfb44: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1038fa89-1900-4e35-bdf6-b66a40abfb44', 'volume_size': 1, 'snapshot_id': '678d3686-a43c-475e-ba1e-061cf311f88b'} Jul 07 22:44:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:33 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d Jul 07 22:44:33 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:34 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d" returned: 0 in 1.328s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] <== create_volume: return (3167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.173s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.305s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b-1038fa89-1900-4e35-bdf6-b66a40abfb44" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1bd2e4-16f8-47c1-9fe8-106d11be8f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b2e63-3e18-4e5d-989b-e179d569be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b-1038fa89-1900-4e35-bdf6-b66a40abfb44" acquired by "_create_volume_from_snapshot" :: waited 0.092s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Creating volume 1038fa89-1900-4e35-bdf6-b66a40abfb44 from snapshot 678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Volume volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d (f3e622e3-105e-4f4e-839d-c3a546e70a8d): created successfully Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b2e63-3e18-4e5d-989b-e179d569be12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (4f4c6828-03f0-4b96-93c3-9fbba4b3dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] snapshot: 678d3686-a43c-475e-ba1e-061cf311f88b, volume: 1038fa89-1900-4e35-bdf6-b66a40abfb44, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2809fbc4-bdbe-437e-bc52-cc5a2c795072 tempest-GroupsTest-1475662796 None] Created volume successfully. Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef347b7c-14a9-4d3e-95da-d892454417ad]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:34 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:34 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (e5f505e0-4a4f-4e15-902c-47eb23d94788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36647a3e-caa5-4a58-b757-3b28ab07f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36647a3e-caa5-4a58-b757-3b28ab07f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135465432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,host='devstack@QuobyteHD#QuobyteHD',id=cd52b087-880a-4d58-ab30-629b24f26efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:36Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9970110-2203-48e4-afa5-829553338342),volume_type_id=b9970110-2203-48e4-afa5-829553338342)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba98f4a6-41ae-4be7-982d-fec629ee8841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba98f4a6-41ae-4be7-982d-fec629ee8841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f1394d-f023-4e31-a515-38e906d802b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f1394d-f023-4e31-a515-38e906d802b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd52b087-880a-4d58-ab30-629b24f26efc', 'volume_name': 'volume-cd52b087-880a-4d58-ab30-629b24f26efc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9078b9f-42c9-4c5f-8823-813c1c464219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9078b9f-42c9-4c5f-8823-813c1c464219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb615dba-24e9-4fa1-8e1c-b0b9809b5ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Volume cd52b087-880a-4d58-ab30-629b24f26efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd52b087-880a-4d58-ab30-629b24f26efc', 'volume_size': 1} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:36 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 2.090s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b69daf-da7e-46e9-85ac-4ad14a33c677]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:36 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:36 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Flow 'volume_create_manager' (f7c6b676-60a5-4ec9-a738-565ce6c387fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e0d2e-b53e-400c-af49-53adac72ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e0d2e-b53e-400c-af49-53adac72ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-992929690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae263934-e06a-4d55-9d41-bd6f34070aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525bc6ecabe84082afad0ddabbaca766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:37Z,use_quota=True,user_id='75675630ca434d3a8bc7aa0868dc2118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eacd499-c671-4781-99fe-adc01bcbd2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eacd499-c671-4781-99fe-adc01bcbd2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7fdf23-cb5f-4aae-aa28-89e9a832c583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7fdf23-cb5f-4aae-aa28-89e9a832c583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae263934-e06a-4d55-9d41-bd6f34070aad', 'volume_name': 'volume-ae263934-e06a-4d55-9d41-bd6f34070aad', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f52c0f-62d6-41eb-90b8-b7fc788e1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f52c0f-62d6-41eb-90b8-b7fc788e1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bcd68e-3e60-4a8e-b170-36097a969d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Volume ae263934-e06a-4d55-9d41-bd6f34070aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae263934-e06a-4d55-9d41-bd6f34070aad', 'volume_size': 1} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:37 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 1.209s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:44:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:38 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 Jul 07 22:44:38 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:45 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44" returned: 0 in 7.689s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493ce81-2c14-4e58-bea4-b96ae9a33b4c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:45 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:45 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:46 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 1.005s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:46 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:44:46 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Converted 1024.00 MB image at 133.15 MB/s Jul 07 22:44:46 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 is being set with open permissions: ugo+rw Jul 07 22:44:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:46 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 Jul 07 22:44:46 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:46 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:INSERT=15,cinder:UPDATE=61,cinder:SELECT=55,cinder:DELETE=5 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=39,cinder:SELECT=40,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Flow 'volume_create_manager' (e009c24d-e5d8-4fe1-b480-9428e496c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed675d71-04e8-4e75-b440-77c704dae322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed675d71-04e8-4e75-b440-77c704dae322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-148914459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57fb563-a6fa-4bec-8bc4-38defdef0831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8efc0a330a4ab486fa12053b02af3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:47Z,use_quota=True,user_id='650c51bf52ac465ba8825f630deb4c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c51967-0de6-407c-afbb-64a1be78720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c51967-0de6-407c-afbb-64a1be78720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e2e58-4649-4871-8fa2-bb3a39871fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:44:47 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44" returned: 0 in 0.662s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" released by "_copy_volume_from_snapshot" :: held 12.860s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b-1038fa89-1900-4e35-bdf6-b66a40abfb44" released by "_create_volume_from_snapshot" :: held 12.928s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.023s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.692s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,created_at=2026-07-07T20:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135465432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b63c5a7a-6060-4ebe-8fce-51d70ef0c391,host='devstack@QuobyteHD#QuobyteHD',id=cd52b087-880a-4d58-ab30-629b24f26efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e088aa608b4707ae0b20fcb7add7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:36Z,use_quota=True,user_id='78b590b2ce3b493796208f2c757bcd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9970110-2203-48e4-afa5-829553338342),volume_type_id=b9970110-2203-48e4-afa5-829553338342)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Creating volume cd52b087-880a-4d58-ab30-629b24f26efc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:47 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:47 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc 1073741824 Jul 07 22:44:47 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba257f5-e9eb-44eb-976f-f199785f62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1038fa89-1900-4e35-bdf6-b66a40abfb44', 'volume_size': 1, 'snapshot_id': '678d3686-a43c-475e-ba1e-061cf311f88b'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb754a1c-7996-4ee8-bc6f-ff5e00f53fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Volume volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 (1038fa89-1900-4e35-bdf6-b66a40abfb44): created successfully Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb754a1c-7996-4ee8-bc6f-ff5e00f53fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Flow 'volume_create_manager' (659a0f8f-63c3-45a8-9376-9d198442a1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-787dcc50-5429-4d24-a33f-3d8c92e7cb91 tempest-VolumesDeleteCascade-1851582135 None] Created volume successfully. Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53e2e58-4649-4871-8fa2-bb3a39871fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e57fb563-a6fa-4bec-8bc4-38defdef0831', 'volume_name': 'volume-e57fb563-a6fa-4bec-8bc4-38defdef0831', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956b560d-4e01-442e-b18e-4a6f048cb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956b560d-4e01-442e-b18e-4a6f048cb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2712f91-933e-4337-9735-79e38f4c66a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:47 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Volume e57fb563-a6fa-4bec-8bc4-38defdef0831: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e57fb563-a6fa-4bec-8bc4-38defdef0831', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Trying to clone e57fb563-a6fa-4bec-8bc4-38defdef0831 from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:44:47 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:44:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca1524-4aea-4848-8f7f-918bc3ee8477]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Performing cascade delete. {{(pid=88087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-678d3686-a43c-475e-ba1e-061cf311f88b-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-678d3686-a43c-475e-ba1e-061cf311f88b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Deleting offline snapshot 678d3686-a43c-475e-ba1e-061cf311f88b of volume 9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] snapshot_file for this snap is: volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ff7dcf-b5bc-4cd1-907f-a8a5192df596]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:48 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD Jul 07 22:44:48 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:48 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:48 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:48 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc 1073741824" returned: 0 in 1.015s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:48 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc Jul 07 22:44:48 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:48 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 is fetched for user 650c51bf52ac465ba8825f630deb4c84. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9123b6e2-0fbe-4686-b35d-326b81299502]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:48 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437e04a-eda6-4ad4-9c51-f17c551bebc5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:49 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD Jul 07 22:44:49 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:49 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc" returned: 0 in 0.691s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:49 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:49 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.966s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-992929690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae263934-e06a-4d55-9d41-bd6f34070aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525bc6ecabe84082afad0ddabbaca766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:37Z,use_quota=True,user_id='75675630ca434d3a8bc7aa0868dc2118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Creating volume ae263934-e06a-4d55-9d41-bd6f34070aad {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:49 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:49 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad 1073741824 Jul 07 22:44:49 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb615dba-24e9-4fa1-8e1c-b0b9809b5ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd52b087-880a-4d58-ab30-629b24f26efc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59870f6-4671-4784-93c6-08acee0efc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Volume volume-cd52b087-880a-4d58-ab30-629b24f26efc (cd52b087-880a-4d58-ab30-629b24f26efc): created successfully Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59870f6-4671-4784-93c6-08acee0efc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Flow 'volume_create_manager' (e5f505e0-4a4f-4e15-902c-47eb23d94788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0dea68da-5d13-40e3-b317-31afd52ebbef tempest-GroupsTest-1475662796 None] Created volume successfully. Jul 07 22:44:49 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:49 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:49 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:49 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:50 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad 1073741824" returned: 0 in 0.907s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:50 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad Jul 07 22:44:50 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-52ecb3d6-37f0-49d6-b34f-e3501086ee34 tempest-GroupsTest-1475662796 None] Update group completed successfully. Jul 07 22:44:50 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 0.758s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:50 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b Jul 07 22:44:50 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:50 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad" returned: 0 in 0.691s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-148914459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57fb563-a6fa-4bec-8bc4-38defdef0831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8efc0a330a4ab486fa12053b02af3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:47Z,use_quota=True,user_id='650c51bf52ac465ba8825f630deb4c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Creating volume e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:44:50 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bcd68e-3e60-4a8e-b170-36097a969d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae263934-e06a-4d55-9d41-bd6f34070aad', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:50 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1073741824 Jul 07 22:44:50 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2066fd-d37a-4509-a25e-1b91586a2da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:44:50 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Volume volume-ae263934-e06a-4d55-9d41-bd6f34070aad (ae263934-e06a-4d55-9d41-bd6f34070aad): created successfully Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2066fd-d37a-4509-a25e-1b91586a2da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:44:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Flow 'volume_create_manager' (f7c6b676-60a5-4ec9-a738-565ce6c387fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:44:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-05be775e-0f45-4725-b35e-de46e93ca01b tempest-TestMinimumBasicScenario-709145230 None] Created volume successfully. Jul 07 22:44:51 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d.678d3686-a43c-475e-ba1e-061cf311f88b" returned: 0 in 0.664s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-678d3686-a43c-475e-ba1e-061cf311f88b" released by "_delete_snapshot" :: held 3.179s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" released by "delete_snapshot" :: held 3.205s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['16b5764e-c143-49f6-8838-65179b83f873', 'd3f624c9-d803-4546-81b4-768cb8df1f15', 'eb5c8beb-57ea-4ff4-92e1-77f7d06d28a5', '32599fef-a3ea-4ef8-a033-f8d40b0aded6'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Delete snapshot completed successfully. Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-678d3686-a43c-475e-ba1e-061cf311f88b-delete_snapshot" released by "delete_snapshot" :: held 3.426s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Snapshots deleted, issuing volume delete {{(pid=88087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5af4bce-b674-4c81-8cd6-e43540641ae4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-94e3b6e9-ff39-435b-8830-812da910c42d tempest-GroupsTest-1475662796 None] Update group completed successfully. Jul 07 22:44:51 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:51 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:51 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1073741824" returned: 0 in 1.116s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:51 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:44:51 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:52 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 0.959s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:52 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d Jul 07 22:44:52 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:52 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Attempting download of bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume e57fb563-a6fa-4bec-8bc4-38defdef0831. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1fdac-acd1-4d63-8012-61830f3a373a]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:52 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th Jul 07 22:44:52 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:53 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" returned: 0 in 0.757s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d" released by "delete_volume" :: held 1.795s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['cf479cb8-cab7-45e8-a049-09f9c9432749', '7198359e-fde2-475b-af09-01354e9b0ae7', '3321cab8-1348-42ee-9ee2-f28dc47f4c44', '31db722e-c249-44d7-8394-14973b8bbf38'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Acquiring lock "cinder-quobyte-cd52b087-880a-4d58-ab30-629b24f26efc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-cd52b087-880a-4d58-ab30-629b24f26efc" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7783571-0207-4bd8-8407-f19a0b6d4599]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:53 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:53 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:53 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc Jul 07 22:44:53 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-1038fa89-1900-4e35-bdf6-b66a40abfb44-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-1038fa89-1900-4e35-bdf6-b66a40abfb44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:53 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th" returned: 0 in 1.115s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0dba0-6678-40c2-ac28-063fc755f8e3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:54 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th Jul 07 22:44:54 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:54 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 Jul 07 22:44:54 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:54 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.290s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:54 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Deleted volume successfully. Jul 07 22:44:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cc639949-906f-47b7-a491-b50d15aa34ba tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-9b75aacd-ee4b-4dcb-b19b-adf7d2c3d17d-delete_volume" released by "delete_volume" :: held 7.008s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:55 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc" returned: 0 in 1.584s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:55 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc Jul 07 22:44:55 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:55 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th" returned: 1 in 1.337s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_sb3mm3th' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23e341-297d-4f1a-b04d-afa3b45d0a92]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0a1e43-8cf3-4050-ba7f-5ff35c76a27b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:55 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44" returned: 0 in 1.280s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:55 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44 Jul 07 22:44:55 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:55 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD Jul 07 22:44:55 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:55 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad Jul 07 22:44:55 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:56 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1038fa89-1900-4e35-bdf6-b66a40abfb44" returned: 0 in 0.775s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-quobyte-1038fa89-1900-4e35-bdf6-b66a40abfb44" released by "delete_volume" :: held 2.133s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:56 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd52b087-880a-4d58-ab30-629b24f26efc" returned: 0 in 1.013s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-cd52b087-880a-4d58-ab30-629b24f26efc" released by "delete_volume" :: held 2.694s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Acquiring lock "cinder-quobyte-f3e622e3-105e-4f4e-839d-c3a546e70a8d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:56 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-f3e622e3-105e-4f4e-839d-c3a546e70a8d" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD" returned: 0 in 0.967s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 was qcow2, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:44:56 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb0265-2fd1-4dc2-b1e6-2f49f689d76a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:56 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:44:56 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad" returned: 0 in 0.967s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.988s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Created reservations ['6f66b971-7666-48d9-96d7-8566fa171717', '5616da19-e174-43a7-9f00-a46114aa6b3b', 'd58dc523-c3ea-4a53-9969-8a163d748480', 'd4546ba4-c1fa-443e-8b83-5e56b95e9fdd'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-ae263934-e06a-4d55-9d41-bd6f34070aad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a3540c5-af02-418e-a106-8cad2be5b6b1', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:56 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d Jul 07 22:44:56 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:56 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:56 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-89ef10cc-4802-4fc9-a54e-e55b69be1cff req-f2711f53-8915-4d31-a816-8f276a8b526b tempest-TestMinimumBasicScenario-709145230 None] attachment_update completed successfully. Jul 07 22:44:57 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.752s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:57 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Deleted volume successfully. Jul 07 22:44:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-27e71717-5df8-4c07-a0e2-4ebf34294b48 tempest-VolumesDeleteCascade-1851582135 None] Lock "cinder-1038fa89-1900-4e35-bdf6-b66a40abfb44-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:57 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d" returned: 0 in 1.083s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:57 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d Jul 07 22:44:57 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:58 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3e622e3-105e-4f4e-839d-c3a546e70a8d" returned: 0 in 0.985s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "cinder-quobyte-f3e622e3-105e-4f4e-839d-c3a546e70a8d" released by "delete_volume" :: held 2.132s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Created reservations ['77854e53-eb79-4c52-a317-5047e3339753'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:58 devstack cinder-volume[88087]: WARNING cinder.quota [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-518707316 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-518707316, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:58 devstack cinder-volume[88087]: WARNING cinder.quota [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-518707316 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-518707316, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Created reservations ['137184dd-56c7-48f6-90d7-510862044fba', '3687ad13-a2b5-4e49-9421-be47c1e28cda', 'ca97a0b9-424c-4533-b0d8-df2ec6643fd1', '4eda918d-ff51-4255-8521-8f4aa115f348'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Created reservations ['2f3754e3-f524-4fca-b133-cf3c0d06e891', 'b363a0e0-fdc5-4104-872c-35e725ac16bc', '1d4db11a-d7c2-4ebf-8bb3-85b8b12e453a', 'a199cb3c-3e6d-4e95-9e18-27934e57292f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:58 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 2.523s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_4c7vvkd5devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:44:58 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Converted 112.00 MB image at 44.37 MB/s Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:58 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1G Jul 07 22:44:58 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:58 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:44:58 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:59 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.706s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-21906e82-70b4-4f19-bc87-6461f5337f96 tempest-GroupsTest-1475662796 None] Delete group completed successfully. Jul 07 22:44:59 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 1G" returned: 0 in 0.809s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1e1ad-6439-468e-9e9d-29fd0bfd1a9e]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:59 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:44:59 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:00 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 0.906s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:00 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:45:00 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:01 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 1 in 0.911s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Downloaded image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume e57fb563-a6fa-4bec-8bc4-38defdef0831 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 for user 650c51bf52ac465ba8825f630deb4c84 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Marking volume e57fb563-a6fa-4bec-8bc4-38defdef0831 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Copying metadata from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 to e57fb563-a6fa-4bec-8bc4-38defdef0831. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Creating volume glance metadata for volume e57fb563-a6fa-4bec-8bc4-38defdef0831 backed by image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2712f91-933e-4337-9735-79e38f4c66a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57fb563-a6fa-4bec-8bc4-38defdef0831', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebee161-4da1-4c30-896a-31a785b79420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:01 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Volume volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 (e57fb563-a6fa-4bec-8bc4-38defdef0831): created successfully Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebee161-4da1-4c30-896a-31a785b79420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Flow 'volume_create_manager' (e009c24d-e5d8-4fe1-b480-9428e496c60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:01 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f78f77cb-5c5e-4b4a-b4f8-414e4a9604de tempest-TestShelveInstance-370936860 None] Created volume successfully. Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Flow 'volume_create_manager' (e4405a0a-b0f3-43c4-b50c-f2afbc362643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7354a2-799a-4e51-bc6a-ffe853968212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7354a2-799a-4e51-bc6a-ffe853968212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-727678572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b951bc-8e40-4b29-b2fd-c9b73661a158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e065f63742041deb63d51d0b5f444ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:04Z,use_quota=True,user_id='5a36968a0ebe46eba3a69e543e017252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb5847-182f-4fb8-b3ae-e86b749a5789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb5847-182f-4fb8-b3ae-e86b749a5789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625087a1-4e30-4f8c-a375-b6281e995674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625087a1-4e30-4f8c-a375-b6281e995674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b951bc-8e40-4b29-b2fd-c9b73661a158', 'volume_name': 'volume-61b951bc-8e40-4b29-b2fd-c9b73661a158', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38842072-ffb6-48fc-b313-fd4ed8547385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38842072-ffb6-48fc-b313-fd4ed8547385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01484173-fc37-41d2-9c1a-5487201d7158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:03 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Volume 61b951bc-8e40-4b29-b2fd-c9b73661a158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b951bc-8e40-4b29-b2fd-c9b73661a158', 'volume_size': 1} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-727678572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b951bc-8e40-4b29-b2fd-c9b73661a158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e065f63742041deb63d51d0b5f444ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:04Z,use_quota=True,user_id='5a36968a0ebe46eba3a69e543e017252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Creating volume 61b951bc-8e40-4b29-b2fd-c9b73661a158 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:03 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:03 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 1073741824 Jul 07 22:45:03 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:05 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 1073741824" returned: 0 in 1.286s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:05 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 Jul 07 22:45:05 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:05 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158" returned: 0 in 0.819s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01484173-fc37-41d2-9c1a-5487201d7158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b951bc-8e40-4b29-b2fd-c9b73661a158', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66682f-48a1-46e5-8393-0991bfc03ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Volume volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 (61b951bc-8e40-4b29-b2fd-c9b73661a158): created successfully Jul 07 22:45:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66682f-48a1-46e5-8393-0991bfc03ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Flow 'volume_create_manager' (e4405a0a-b0f3-43c4-b50c-f2afbc362643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-70eb5f7d-89e6-4564-a848-aaba5f98a85f tempest-VolumesTransfersV355Test-768367858 None] Created volume successfully. Jul 07 22:45:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5b98a3d9-bf63-43dd-a3d5-d78e03c9f361 tempest-VolumesTransfersV355Test-690351801 None] Transfer volume completed successfully. Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Flow 'volume_create_manager' (3d26a42f-ad74-4678-9140-46f87c687031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7d29b8-f6e6-4b3d-b948-306fe0783d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7d29b8-f6e6-4b3d-b948-306fe0783d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1995784915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afeae2c-1668-477e-b00b-0af54c2a8122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7202b8341a4b48b8f64ed5d76cc67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:09Z,use_quota=True,user_id='89f7739fe5a2411384526c1405d2a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dcaa1e-01f4-4b5f-957a-33fb7efb0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dcaa1e-01f4-4b5f-957a-33fb7efb0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4e7c55-3436-4111-b706-04327c7378cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4e7c55-3436-4111-b706-04327c7378cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afeae2c-1668-477e-b00b-0af54c2a8122', 'volume_name': 'volume-1afeae2c-1668-477e-b00b-0af54c2a8122', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9db68e5-41d7-42bf-971f-848528ff32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9db68e5-41d7-42bf-971f-848528ff32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdcb02c-2811-4d69-be6e-c6a9b5bb1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume 1afeae2c-1668-477e-b00b-0af54c2a8122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afeae2c-1668-477e-b00b-0af54c2a8122', 'volume_size': 1} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1995784915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afeae2c-1668-477e-b00b-0af54c2a8122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7202b8341a4b48b8f64ed5d76cc67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:09Z,use_quota=True,user_id='89f7739fe5a2411384526c1405d2a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Creating volume 1afeae2c-1668-477e-b00b-0af54c2a8122 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:08 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "cinder-61b951bc-8e40-4b29-b2fd-c9b73661a158-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-61b951bc-8e40-4b29-b2fd-c9b73661a158-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:08 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 1073741824 Jul 07 22:45:08 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "cinder-quobyte-61b951bc-8e40-4b29-b2fd-c9b73661a158" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-quobyte-61b951bc-8e40-4b29-b2fd-c9b73661a158" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b719cce-8ff5-40d4-a2e6-0b2a7afc44e3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:09 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 Jul 07 22:45:09 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:10 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 1073741824" returned: 0 in 1.298s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:10 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158" returned: 0 in 1.137s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:10 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158 Jul 07 22:45:10 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:10 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 Jul 07 22:45:10 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:11 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122" returned: 0 in 0.904s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.292s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:11 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-61b951bc-8e40-4b29-b2fd-c9b73661a158" returned: 0 in 0.979s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdcb02c-2811-4d69-be6e-c6a9b5bb1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afeae2c-1668-477e-b00b-0af54c2a8122', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c6d03-af09-431e-822c-5772269606f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-quobyte-61b951bc-8e40-4b29-b2fd-c9b73661a158" released by "delete_volume" :: held 2.240s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c10a7a-0957-4028-b001-19a353f9aba7]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:11 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume volume-1afeae2c-1668-477e-b00b-0af54c2a8122 (1afeae2c-1668-477e-b00b-0af54c2a8122): created successfully Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c6d03-af09-431e-822c-5772269606f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Flow 'volume_create_manager' (3d26a42f-ad74-4678-9140-46f87c687031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0c54e4bc-7c17-44a2-ab70-2657772a2743 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Created volume successfully. Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Created reservations ['fd0eb822-e6b1-45c7-835e-383b554284f8', '6f5825d6-d027-48ac-83a4-a837ef01e765', '05777268-9c7f-4888-9149-08bc49d1edec', '2a456237-c276-4aae-a05d-5d396a4aea5b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:11 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:45:11 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:11 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:11 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "cinder-1afeae2c-1668-477e-b00b-0af54c2a8122-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "cinder-1afeae2c-1668-477e-b00b-0af54c2a8122-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "cinder-quobyte-1afeae2c-1668-477e-b00b-0af54c2a8122" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "cinder-quobyte-1afeae2c-1668-477e-b00b-0af54c2a8122" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d09ec4-95d6-42e7-80cb-3853098d450f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:12 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.830s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Deleted volume successfully. Jul 07 22:45:12 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 Jul 07 22:45:12 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:12 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 1.052s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1688aa29-6d08-41e3-9c6f-c72dd30d5781 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-61b951bc-8e40-4b29-b2fd-c9b73661a158-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:12 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:45:12 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Flow 'volume_create_manager' (4469f863-9ec1-402f-a091-99be9733c243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8621cb38-5b2f-46b4-a189-73c0cb50f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8621cb38-5b2f-46b4-a189-73c0cb50f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-334174152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b6df7-1b51-475e-9672-d027a27f6db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e065f63742041deb63d51d0b5f444ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:13Z,use_quota=True,user_id='5a36968a0ebe46eba3a69e543e017252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:13 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4e2be2-4370-43a6-9889-75b5003fa58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4e2be2-4370-43a6-9889-75b5003fa58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b78dc43-6140-4b15-af3e-10e24d6d1df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b78dc43-6140-4b15-af3e-10e24d6d1df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045b6df7-1b51-475e-9672-d027a27f6db1', 'volume_name': 'volume-045b6df7-1b51-475e-9672-d027a27f6db1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e1283c-8c76-4e68-b538-a4b1a7737f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e1283c-8c76-4e68-b538-a4b1a7737f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22f92d-7081-49a7-9b35-4aea666bccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:13 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Volume 045b6df7-1b51-475e-9672-d027a27f6db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045b6df7-1b51-475e-9672-d027a27f6db1', 'volume_size': 1} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122" returned: 0 in 1.187s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:13 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122 Jul 07 22:45:13 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:13 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 1 in 1.126s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.255s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-334174152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b6df7-1b51-475e-9672-d027a27f6db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e065f63742041deb63d51d0b5f444ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:13Z,use_quota=True,user_id='5a36968a0ebe46eba3a69e543e017252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Creating volume 045b6df7-1b51-475e-9672-d027a27f6db1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:13 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:13 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 1073741824 Jul 07 22:45:13 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-e57fb563-a6fa-4bec-8bc4-38defdef0831', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '400865a9-c79f-4ddb-b141-a90c888aa3d5', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:45:13 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-70dd2410-cdb0-4ff3-8873-a075fde3ed61 req-ced950e7-6800-4bcb-bceb-c013dd68072a tempest-TestShelveInstance-370936860 None] attachment_update completed successfully. Jul 07 22:45:14 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1afeae2c-1668-477e-b00b-0af54c2a8122" returned: 0 in 0.750s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "cinder-quobyte-1afeae2c-1668-477e-b00b-0af54c2a8122" released by "delete_volume" :: held 1.983s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Created reservations ['ac37aa81-1a58-4244-bae7-39b8e565918d', '04be7288-1a97-4859-9f90-c5328464653c', 'd92038ce-f4eb-445b-a22b-09882dc62de9', 'fd7e2b0b-46de-42fc-8105-049a1c2f0789'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:14 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:14 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:14 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 1073741824" returned: 0 in 1.091s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:14 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 Jul 07 22:45:14 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Flow 'volume_create_manager' (ac327bd4-20ed-47ff-a8da-6689d54de548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128a5b1c-9a61-4922-ba2f-cbc995b3de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128a5b1c-9a61-4922-ba2f-cbc995b3de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-484037740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464166f2-54f8-4a35-9faa-7cb83d2a14ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7202b8341a4b48b8f64ed5d76cc67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:15Z,use_quota=True,user_id='89f7739fe5a2411384526c1405d2a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4479391c-9fb3-4915-88c6-d34d3f088250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4479391c-9fb3-4915-88c6-d34d3f088250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f935d32-c4cd-4466-9ddb-3857a5782c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f935d32-c4cd-4466-9ddb-3857a5782c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464166f2-54f8-4a35-9faa-7cb83d2a14ab', 'volume_name': 'volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62818862-e4d9-41f1-94f0-f49de13d457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62818862-e4d9-41f1-94f0-f49de13d457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36de3e8-916f-4f4e-a846-aec63f2a66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume 464166f2-54f8-4a35-9faa-7cb83d2a14ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab', 'volume_size': 1} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:15 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.849s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Deleted volume successfully. Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db36ecbb-fd9e-4842-9e1b-b7d6320d1f37 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "cinder-1afeae2c-1668-477e-b00b-0af54c2a8122-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:15 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1" returned: 0 in 0.766s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-484037740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464166f2-54f8-4a35-9faa-7cb83d2a14ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7202b8341a4b48b8f64ed5d76cc67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:15Z,use_quota=True,user_id='89f7739fe5a2411384526c1405d2a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Creating volume 464166f2-54f8-4a35-9faa-7cb83d2a14ab {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:15 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e22f92d-7081-49a7-9b35-4aea666bccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045b6df7-1b51-475e-9672-d027a27f6db1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab 1073741824 Jul 07 22:45:15 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5a2cc5-f5f9-4691-9b61-360837420d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Volume volume-045b6df7-1b51-475e-9672-d027a27f6db1 (045b6df7-1b51-475e-9672-d027a27f6db1): created successfully Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5a2cc5-f5f9-4691-9b61-360837420d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Flow 'volume_create_manager' (4469f863-9ec1-402f-a091-99be9733c243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e5624048-40cc-41d9-a853-c1da996415a7 tempest-VolumesTransfersV355Test-768367858 None] Created volume successfully. Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:15 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:15 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:16 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:45:16 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab 1073741824" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:16 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab Jul 07 22:45:16 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "cinder-045b6df7-1b51-475e-9672-d027a27f6db1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-045b6df7-1b51-475e-9672-d027a27f6db1-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "cinder-quobyte-045b6df7-1b51-475e-9672-d027a27f6db1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-quobyte-045b6df7-1b51-475e-9672-d027a27f6db1" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf7c8a-6d32-4a9a-9240-4c68fb7bb3c2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:17 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 Jul 07 22:45:17 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:17 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab" returned: 0 in 1.119s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36de3e8-916f-4f4e-a846-aec63f2a66e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd2045b-0cde-4618-afc3-063c5f8e61fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:17 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Volume volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab (464166f2-54f8-4a35-9faa-7cb83d2a14ab): created successfully Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd2045b-0cde-4618-afc3-063c5f8e61fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Flow 'volume_create_manager' (ac327bd4-20ed-47ff-a8da-6689d54de548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1b834a9e-4278-4f0e-99f9-d424a5420d12 tempest-VolumeQuotasAdminTestJSON-1973549513 None] Created volume successfully. Jul 07 22:45:18 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1" returned: 0 in 0.902s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:18 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1 Jul 07 22:45:18 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:18 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-045b6df7-1b51-475e-9672-d027a27f6db1" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-quobyte-045b6df7-1b51-475e-9672-d027a27f6db1" released by "delete_volume" :: held 1.745s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Created reservations ['fd03ca56-80f3-40d3-b6d0-111e90af9aca', '78dd3670-0728-4ed5-95ce-aacd4efcebfe', '23fedf07-1f25-457c-a30f-e37cf3e33fdc', '918eea3e-706d-48d7-bbc6-dad7cf4a4c5c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:19 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:19 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ddbcb2d5-0489-43b7-b715-ce05b07d67b2 tempest-VolumeQuotasAdminTestJSON-1796341184 None] Transfer volume completed successfully. Jul 07 22:45:20 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.002s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:20 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Deleted volume successfully. Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa9f9eb5-ebe0-445f-adf0-4a0a90a39056 tempest-VolumesTransfersV355Test-2013528053 None] Lock "cinder-045b6df7-1b51-475e-9672-d027a27f6db1-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Acquiring lock "cinder-464166f2-54f8-4a35-9faa-7cb83d2a14ab-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "cinder-464166f2-54f8-4a35-9faa-7cb83d2a14ab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Acquiring lock "cinder-quobyte-464166f2-54f8-4a35-9faa-7cb83d2a14ab" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "cinder-quobyte-464166f2-54f8-4a35-9faa-7cb83d2a14ab" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c811bc3-b822-4566-bd66-0b934520376d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:20 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab Jul 07 22:45:20 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:21 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab" returned: 0 in 1.301s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:22 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab Jul 07 22:45:22 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:23 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-464166f2-54f8-4a35-9faa-7cb83d2a14ab" returned: 0 in 1.342s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "cinder-quobyte-464166f2-54f8-4a35-9faa-7cb83d2a14ab" released by "delete_volume" :: held 2.734s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Created reservations ['6cfe6d9c-140c-4f51-95d1-1eba4864c3d1', '85b1959d-2f31-492f-92e9-3aa9e4860156', '24a24800-01f1-4582-8153-3c17a3446363', '86112a05-6a01-4966-9959-dd5fc08a3733'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:23 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:23 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:25 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.585s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:25 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Deleted volume successfully. Jul 07 22:45:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-688ff02e-4425-445a-b517-263d3c5e5677 tempest-VolumeQuotasAdminTestJSON-600686317 None] Lock "cinder-464166f2-54f8-4a35-9faa-7cb83d2a14ab-delete_volume" released by "delete_volume" :: held 4.755s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:33 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=86,cinder:UPDATE=95,cinder:DELETE=8,cinder:INSERT=28 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:45:35 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=84,cinder:UPDATE=106,cinder:INSERT=29,cinder:DELETE=6 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Flow 'volume_create_manager' (e1366c5c-63cc-42ad-b0a5-345b5e6807fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434f3d41-78bc-4800-9917-5687fa0ac724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434f3d41-78bc-4800-9917-5687fa0ac724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-418540817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e2208-1baf-41b4-8647-85d632caf2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f5bba697a542acbcc7eb4f7bd76c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:37Z,use_quota=True,user_id='a648821ef7f74a2985a9a64b55cccb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818451e-efc2-48b9-8296-ba24dcd32ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2818451e-efc2-48b9-8296-ba24dcd32ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d42e8fd-3a43-4ea6-87b7-e8cd08068db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d42e8fd-3a43-4ea6-87b7-e8cd08068db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95e2208-1baf-41b4-8647-85d632caf2f1', 'volume_name': 'volume-b95e2208-1baf-41b4-8647-85d632caf2f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a86f5dc-56a7-4307-83c1-2dbc350d1579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a86f5dc-56a7-4307-83c1-2dbc350d1579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78027391-62dc-485f-8b12-a8240f4247b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Volume b95e2208-1baf-41b4-8647-85d632caf2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95e2208-1baf-41b4-8647-85d632caf2f1', 'volume_size': 1} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-418540817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e2208-1baf-41b4-8647-85d632caf2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f5bba697a542acbcc7eb4f7bd76c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:37Z,use_quota=True,user_id='a648821ef7f74a2985a9a64b55cccb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Creating volume b95e2208-1baf-41b4-8647-85d632caf2f1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:36 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:36 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 1073741824 Jul 07 22:45:36 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:38 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 1073741824" returned: 0 in 1.455s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:38 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 Jul 07 22:45:38 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:39 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1" returned: 0 in 1.204s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] <== create_volume: return (2722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.726s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78027391-62dc-485f-8b12-a8240f4247b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95e2208-1baf-41b4-8647-85d632caf2f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47755bca-38e0-40b1-ad22-3f7406d13aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:39 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Volume volume-b95e2208-1baf-41b4-8647-85d632caf2f1 (b95e2208-1baf-41b4-8647-85d632caf2f1): created successfully Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47755bca-38e0-40b1-ad22-3f7406d13aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Flow 'volume_create_manager' (e1366c5c-63cc-42ad-b0a5-345b5e6807fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-262fc0e9-9ab9-446a-babd-4e3c9a8dcc59 tempest-VolumesServicesTestJSON-801591287 None] Created volume successfully. Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Acquiring lock "cinder-b95e2208-1baf-41b4-8647-85d632caf2f1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "cinder-b95e2208-1baf-41b4-8647-85d632caf2f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Acquiring lock "cinder-quobyte-b95e2208-1baf-41b4-8647-85d632caf2f1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "cinder-quobyte-b95e2208-1baf-41b4-8647-85d632caf2f1" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[625fb796-27b7-4285-9712-8e7ff2ec746c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:40 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 Jul 07 22:45:40 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:41 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1" returned: 0 in 0.886s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:41 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1 Jul 07 22:45:41 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:42 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b95e2208-1baf-41b4-8647-85d632caf2f1" returned: 0 in 0.922s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "cinder-quobyte-b95e2208-1baf-41b4-8647-85d632caf2f1" released by "delete_volume" :: held 1.869s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Created reservations ['ae1bea0d-f0a3-4c03-8370-e74a0f78ca6a', '02e2e110-edc5-4536-a43b-0eee5368a418', 'f2d9f5cb-5810-4387-9f6e-022a33187ad9', '2314dccc-c143-4e3d-aab5-a2363e1a619e'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:42 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:42 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Flow 'volume_create_manager' (30dcd6a9-61b5-423e-8509-20b5032447ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ed6115-188f-4623-8bb2-1401efe9e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ed6115-188f-4623-8bb2-1401efe9e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627792315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676f480e4d1d4258afebaeb217abe5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:43Z,use_quota=True,user_id='7d59ff1b6e374ab79812706f5a0d2739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00e8d60-6b91-4497-8f0b-91c713d530bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00e8d60-6b91-4497-8f0b-91c713d530bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1bf323-7e6d-4810-8346-719d858a3ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1bf323-7e6d-4810-8346-719d858a3ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb', 'volume_name': 'volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09485a3-1bc4-44c2-a941-0ad5ef45c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09485a3-1bc4-44c2-a941-0ad5ef45c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773aca45-d373-4973-9a64-e95f2f6eb8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb', 'volume_size': 1} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627792315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676f480e4d1d4258afebaeb217abe5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:43Z,use_quota=True,user_id='7d59ff1b6e374ab79812706f5a0d2739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Creating volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:43 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:43 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb 1073741824 Jul 07 22:45:43 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:43 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.757s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Deleted volume successfully. Jul 07 22:45:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae9a87a6-f264-45b8-ba4e-81276a86e790 tempest-VolumesServicesTestJSON-801591287 None] Lock "cinder-b95e2208-1baf-41b4-8647-85d632caf2f1-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:44 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb 1073741824" returned: 0 in 1.048s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:44 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:45:44 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:44 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.791s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773aca45-d373-4973-9a64-e95f2f6eb8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aba583-9074-4201-888c-8828da9b3f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Volume volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb (85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb): created successfully Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aba583-9074-4201-888c-8828da9b3f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Flow 'volume_create_manager' (30dcd6a9-61b5-423e-8509-20b5032447ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ab3de293-1ed3-4d55-8e9b-0aa253b8058d tempest-VolumesActionsTest-1390037247 None] Created volume successfully. Jul 07 22:45:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-44cdf994-597c-403d-8ebc-f41394fe6a68 req-8d21afc8-56ca-4ca8-b9de-d040fd222614 tempest-TestMinimumBasicScenario-709145230 None] Terminate volume connection completed successfully. Jul 07 22:45:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-44cdf994-597c-403d-8ebc-f41394fe6a68 req-8d21afc8-56ca-4ca8-b9de-d040fd222614 tempest-TestMinimumBasicScenario-709145230 None] Deleting attachment 8a3540c5-af02-418e-a106-8cad2be5b6b1. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:45:55 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "cinder-ae263934-e06a-4d55-9d41-bd6f34070aad-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "cinder-ae263934-e06a-4d55-9d41-bd6f34070aad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "cinder-quobyte-ae263934-e06a-4d55-9d41-bd6f34070aad" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "cinder-quobyte-ae263934-e06a-4d55-9d41-bd6f34070aad" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de9ecb2-312c-4990-b26e-de0fc423ad2a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-32d94a65-40fc-46a4-8c65-e6845e3ce882 req-09bdf218-473f-4e74-87bc-659b5009cb1c tempest-TestShelveInstance-370936860 None] Terminate volume connection completed successfully. Jul 07 22:45:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-32d94a65-40fc-46a4-8c65-e6845e3ce882 req-09bdf218-473f-4e74-87bc-659b5009cb1c tempest-TestShelveInstance-370936860 None] Deleting attachment 400865a9-c79f-4ddb-b141-a90c888aa3d5. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:45:56 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad Jul 07 22:45:56 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:57 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad" returned: 0 in 1.062s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:57 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad Jul 07 22:45:57 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:58 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae263934-e06a-4d55-9d41-bd6f34070aad" returned: 0 in 1.008s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "cinder-quobyte-ae263934-e06a-4d55-9d41-bd6f34070aad" released by "delete_volume" :: held 2.152s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Created reservations ['3bcbea95-4562-4da3-9faf-76cd5dae75de', '5a7243bc-2a70-4680-b88b-64044330d146', '4734af17-c627-4bb6-a115-987fa6fff857', 'd5ddac9f-f292-45b7-b26b-ce5f25591c6b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:58 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:45:58 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:59 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.953s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Deleted volume successfully. Jul 07 22:45:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e152698d-b155-42c7-987b-082a03a3f4b4 tempest-TestMinimumBasicScenario-709145230 None] Lock "cinder-ae263934-e06a-4d55-9d41-bd6f34070aad-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Flow 'volume_create_manager' (20d5430e-17f8-4635-ab2d-601861daf82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b597f8-5b0f-4b8c-9c90-e3fde613e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b597f8-5b0f-4b8c-9c90-e3fde613e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-986037942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7eb8acb-0289-4197-8ca7-7386d8aaaa87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97724d395c9c4842970976172f7abade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:01Z,use_quota=True,user_id='4f8f59ffdba3464ead5e46214b261440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5229d885-a5ac-4f2e-ac3d-b0d070c3f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5229d885-a5ac-4f2e-ac3d-b0d070c3f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b085111-33ae-47fc-80a4-60c48313f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b085111-33ae-47fc-80a4-60c48313f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7eb8acb-0289-4197-8ca7-7386d8aaaa87', 'volume_name': 'volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac948af-1dfc-49c5-8607-185c73a49fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac948af-1dfc-49c5-8607-185c73a49fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6612d9-2c1d-47d7-a44c-1371962b0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:01 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Volume e7eb8acb-0289-4197-8ca7-7386d8aaaa87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87', 'volume_size': 1} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-986037942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7eb8acb-0289-4197-8ca7-7386d8aaaa87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97724d395c9c4842970976172f7abade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:01Z,use_quota=True,user_id='4f8f59ffdba3464ead5e46214b261440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Creating volume e7eb8acb-0289-4197-8ca7-7386d8aaaa87 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:01 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:01 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 1073741824 Jul 07 22:46:01 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:03 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 1073741824" returned: 0 in 1.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:03 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 Jul 07 22:46:03 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:04 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" returned: 0 in 0.970s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] <== create_volume: return (2874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.234s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6612d9-2c1d-47d7-a44c-1371962b0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455dc485-be15-4303-aca9-f0cbea801889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Volume volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 (e7eb8acb-0289-4197-8ca7-7386d8aaaa87): created successfully Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455dc485-be15-4303-aca9-f0cbea801889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Flow 'volume_create_manager' (20d5430e-17f8-4635-ab2d-601861daf82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153ba8f-9075-4f91-b586-ef068f5f6de2]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f0eefcc5-6150-45c2-8e56-650e6ba655cd tempest-AbsoluteLimitsTests-1621414945 None] Created volume successfully. Jul 07 22:46:04 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:46:04 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Acquiring lock "cinder-e7eb8acb-0289-4197-8ca7-7386d8aaaa87-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "cinder-e7eb8acb-0289-4197-8ca7-7386d8aaaa87-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Acquiring lock "cinder-quobyte-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "cinder-quobyte-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af1b94-2643-4cf7-84cc-1bfdc61d682d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:05 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 Jul 07 22:46:05 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:05 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 1.135s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b3348233-6733-4774-a82b-f3791acb2c4b tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" by "attach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b3348233-6733-4774-a82b-f3791acb2c4b tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" acquired by "attach_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b3348233-6733-4774-a82b-f3791acb2c4b tempest-VolumesActionsTest-1390037247 None] Attaching volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb to instance 9a49acbf-5d92-4f98-813f-013dd1e214d1 at mountpoint /dev/vdb on host None. Jul 07 22:46:05 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:46:05 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b3348233-6733-4774-a82b-f3791acb2c4b tempest-VolumesActionsTest-1390037247 None] Attach volume completed successfully. Jul 07 22:46:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b3348233-6733-4774-a82b-f3791acb2c4b tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" released by "attach_volume" :: held 0.133s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fdca0c29-0c3f-4cb3-a594-aadbb6366a7d tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" by "detach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fdca0c29-0c3f-4cb3-a594-aadbb6366a7d tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fdca0c29-0c3f-4cb3-a594-aadbb6366a7d tempest-VolumesActionsTest-1390037247 None] Detaching volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb from instance 9a49acbf-5d92-4f98-813f-013dd1e214d1. Jul 07 22:46:06 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" returned: 0 in 1.213s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:06 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87 Jul 07 22:46:06 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fdca0c29-0c3f-4cb3-a594-aadbb6366a7d tempest-VolumesActionsTest-1390037247 None] Detach volume completed successfully. Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fdca0c29-0c3f-4cb3-a594-aadbb6366a7d tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:06 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 1 in 1.063s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.270s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-e57fb563-a6fa-4bec-8bc4-38defdef0831', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e9cf83f-7083-47b6-ad12-a6cb06537dbc', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:46:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-e5d50600-ac38-4dc1-b7a9-14a11d22d9b5 req-b49ac208-0fe7-4ad7-8b39-0a7db2326e4c tempest-TestShelveInstance-370936860 None] attachment_update completed successfully. Jul 07 22:46:07 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" returned: 0 in 0.879s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "cinder-quobyte-e7eb8acb-0289-4197-8ca7-7386d8aaaa87" released by "delete_volume" :: held 2.186s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Created reservations ['73e06cdb-e62c-4b0e-9fa5-6b3d2a6be308', 'c6390b3a-c9c3-43a4-badd-b2726c034b24', '3d99e023-4cc7-419f-a138-873647633934', '724c4601-8ef3-462f-9b31-19a0da1db41e'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:07 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:07 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:08 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.712s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:08 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Deleted volume successfully. Jul 07 22:46:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-916e2215-cb4c-4cc2-9439-706fbc71248a tempest-AbsoluteLimitsTests-1621414945 None] Lock "cinder-e7eb8acb-0289-4197-8ca7-7386d8aaaa87-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Flow 'volume_create_manager' (c202bbe6-a587-4d00-91cd-66a911e334b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b79a64c-8d3a-4a5a-930a-5801d4df1f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b79a64c-8d3a-4a5a-930a-5801d4df1f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1379166847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d964639-6711-4686-a5cd-74ab6e0eee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df9579e2ac748cc8f04a968623158c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:15Z,use_quota=True,user_id='50d57eed63be4564aae5ce9a2699c571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a393f3-4a6c-4e30-88f2-41276fdbeaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a393f3-4a6c-4e30-88f2-41276fdbeaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852c2ea5-5e2b-4167-bb1a-d1d7dac12c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852c2ea5-5e2b-4167-bb1a-d1d7dac12c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d964639-6711-4686-a5cd-74ab6e0eee06', 'volume_name': 'volume-4d964639-6711-4686-a5cd-74ab6e0eee06', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553c557-486c-424f-95fd-bdd38462f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553c557-486c-424f-95fd-bdd38462f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62612967-3453-4669-8070-93324c979798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:14 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Volume 4d964639-6711-4686-a5cd-74ab6e0eee06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d964639-6711-4686-a5cd-74ab6e0eee06', 'volume_size': 1} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1379166847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d964639-6711-4686-a5cd-74ab6e0eee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df9579e2ac748cc8f04a968623158c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:15Z,use_quota=True,user_id='50d57eed63be4564aae5ce9a2699c571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Creating volume 4d964639-6711-4686-a5cd-74ab6e0eee06 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:14 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:14 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 1073741824 Jul 07 22:46:14 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:15 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:15 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:15 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 1073741824" returned: 0 in 1.070s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:16 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 Jul 07 22:46:16 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:16 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.084s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:46:16 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62612967-3453-4669-8070-93324c979798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d964639-6711-4686-a5cd-74ab6e0eee06', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb62ba0-7663-4d66-b554-1735f4388b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Volume volume-4d964639-6711-4686-a5cd-74ab6e0eee06 (4d964639-6711-4686-a5cd-74ab6e0eee06): created successfully Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb62ba0-7663-4d66-b554-1735f4388b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Flow 'volume_create_manager' (c202bbe6-a587-4d00-91cd-66a911e334b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:16 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-570727ea-18b4-46cd-bf56-6d1128f6b09c tempest-VolumesMetadataTest-180092727 None] Created volume successfully. Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Acquiring lock "cinder-4d964639-6711-4686-a5cd-74ab6e0eee06-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "cinder-4d964639-6711-4686-a5cd-74ab6e0eee06-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Acquiring lock "cinder-quobyte-4d964639-6711-4686-a5cd-74ab6e0eee06" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "cinder-quobyte-4d964639-6711-4686-a5cd-74ab6e0eee06" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc00b4-ae3f-4740-a1db-492e85f1e2b7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:19 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 Jul 07 22:46:19 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:20 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06" returned: 0 in 1.106s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:20 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06 Jul 07 22:46:20 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:21 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4d964639-6711-4686-a5cd-74ab6e0eee06" returned: 0 in 0.853s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "cinder-quobyte-4d964639-6711-4686-a5cd-74ab6e0eee06" released by "delete_volume" :: held 2.014s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Created reservations ['c92ee0dc-7a49-41eb-9844-7c968c3d6ba1', 'c7022546-4078-478c-bb77-ebe9b1a24235', '825ba4c2-71ea-42fb-b8f7-605577637e81', '9d7e5766-d395-4243-bd5d-c876d86a5f44'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:21 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:21 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:22 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.580s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:23 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Deleted volume successfully. Jul 07 22:46:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-dbc208b3-88bf-4d47-91c8-0c10fec0631b tempest-VolumesMetadataTest-180092727 None] Lock "cinder-4d964639-6711-4686-a5cd-74ab6e0eee06-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (d42f12af-7345-4582-8210-d9ad0f24fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10fde35-83d1-4d5c-939d-130745895062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10fde35-83d1-4d5c-939d-130745895062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646711779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882fba6-07b2-4c78-910c-40b6b8aa5c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57af8fb-1e0f-4907-ad61-5947bab4abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57af8fb-1e0f-4907-ad61-5947bab4abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a552aa6-a6eb-4c23-a0e8-ab12f51413fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a552aa6-a6eb-4c23-a0e8-ab12f51413fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8882fba6-07b2-4c78-910c-40b6b8aa5c16', 'volume_name': 'volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1886e652-b15e-428b-a3ff-56573db2e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1886e652-b15e-428b-a3ff-56573db2e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2c87ad-9d89-4a66-baaf-29c2aede3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:25 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Volume 8882fba6-07b2-4c78-910c-40b6b8aa5c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16', 'volume_size': 1} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646711779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882fba6-07b2-4c78-910c-40b6b8aa5c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Creating volume 8882fba6-07b2-4c78-910c-40b6b8aa5c16 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:25 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:25 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 1073741824 Jul 07 22:46:25 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (da996a0c-0c59-46db-8a42-222e4c471384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f34d13-0031-485c-9216-7e9b464cdf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f34d13-0031-485c-9216-7e9b464cdf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83027099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c407510-2844-487c-b6dd-697d84f664bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a321d4d-1cfb-441e-bac6-6bab3083907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a321d4d-1cfb-441e-bac6-6bab3083907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef76819-0829-43cb-bcf2-3367ab01b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef76819-0829-43cb-bcf2-3367ab01b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c407510-2844-487c-b6dd-697d84f664bf', 'volume_name': 'volume-1c407510-2844-487c-b6dd-697d84f664bf', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1151528e-4acc-4d32-ad93-dd966b8470ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1151528e-4acc-4d32-ad93-dd966b8470ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e664730-c4ec-49bb-94b1-7941fbab7786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:26 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Volume 1c407510-2844-487c-b6dd-697d84f664bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c407510-2844-487c-b6dd-697d84f664bf', 'volume_size': 1} Jul 07 22:46:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (166c2d9a-e301-41a5-a251-6a86abaf858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c30419a-51d1-4924-93e9-9a7d6268b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c30419a-51d1-4924-93e9-9a7d6268b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225088028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f885bb-5f7f-4021-8431-46aeab37aa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:27Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef451a-867e-430b-ab72-e7cd7bcdddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaef451a-867e-430b-ab72-e7cd7bcdddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcebfcb2-9be6-4e4f-b0e8-f3c5f6881876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcebfcb2-9be6-4e4f-b0e8-f3c5f6881876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f885bb-5f7f-4021-8431-46aeab37aa64', 'volume_name': 'volume-a0f885bb-5f7f-4021-8431-46aeab37aa64', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3171a806-7fb3-45e7-befc-62fad2ab0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3171a806-7fb3-45e7-befc-62fad2ab0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f3643-db86-4504-8878-e96b974113d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Volume a0f885bb-5f7f-4021-8431-46aeab37aa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f885bb-5f7f-4021-8431-46aeab37aa64', 'volume_size': 1} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:27 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (4aa537d2-c793-45ba-8f53-b0f3cf6dc11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48358e24-501c-45f2-b30f-cc5516e1ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 1073741824" returned: 0 in 1.811s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48358e24-501c-45f2-b30f-cc5516e1ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-716616927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06be7620-9a68-4ddb-ab70-f8fa494b206a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:28Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc076424-9043-4225-9bf1-22cea354bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc076424-9043-4225-9bf1-22cea354bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4c999c-1234-4828-bd55-bb138f6da4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4c999c-1234-4828-bd55-bb138f6da4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06be7620-9a68-4ddb-ab70-f8fa494b206a', 'volume_name': 'volume-06be7620-9a68-4ddb-ab70-f8fa494b206a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ae8325-2b21-41ca-bdad-a96d14793740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ae8325-2b21-41ca-bdad-a96d14793740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6316d19-ca36-462c-99f3-0e99d6b06b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Volume 06be7620-9a68-4ddb-ab70-f8fa494b206a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06be7620-9a68-4ddb-ab70-f8fa494b206a', 'volume_size': 1} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:27 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 Jul 07 22:46:27 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (49518f2e-aaa7-40e7-8df9-2e6cda6410e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e66c6f6-d547-41e0-af6d-9927bbbdb2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e66c6f6-d547-41e0-af6d-9927bbbdb2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272670964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8b784d-07b5-4d61-bc99-45cea62eb6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:28Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8864c6-1133-4419-878c-b239a8a6fd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8864c6-1133-4419-878c-b239a8a6fd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bb1520-a928-4cce-8022-0e2f10c6818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bb1520-a928-4cce-8022-0e2f10c6818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8b784d-07b5-4d61-bc99-45cea62eb6ae', 'volume_name': 'volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08f892-839f-4b49-93dc-9993a535f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08f892-839f-4b49-93dc-9993a535f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264a02f6-7bae-43cf-85d9-ce486760c567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Volume ac8b784d-07b5-4d61-bc99-45cea62eb6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae', 'volume_size': 1} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Flow 'volume_create_manager' (2e0e2ca3-aa08-4618-9d73-47a54c9597a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256186ff-3c1e-44a1-bbbd-3abf404721b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256186ff-3c1e-44a1-bbbd-3abf404721b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-561275874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2108ad1-dcf1-4a64-b3a6-596791f63aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122839f45eb6407b9f2aae8233c27cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:29Z,use_quota=True,user_id='f38dd09d444445a88b1682445961e4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e5a471-1813-438e-8c09-25f024b38ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e5a471-1813-438e-8c09-25f024b38ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c48d3d0-bac4-4ea1-9d29-bee8191f6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c48d3d0-bac4-4ea1-9d29-bee8191f6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'volume_name': 'volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6791b92-fe34-4fc2-a566-fb2247cbd4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6791b92-fe34-4fc2-a566-fb2247cbd4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badf1958-10eb-4f9b-9d1a-ac8df643ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Volume c2108ad1-dcf1-4a64-b3a6-596791f63aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'volume_size': 1} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:28 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16" returned: 0 in 1.007s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] <== create_volume: return (2943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.949s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.250s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-83027099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c407510-2844-487c-b6dd-697d84f664bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Creating volume 1c407510-2844-487c-b6dd-697d84f664bf {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:28 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2c87ad-9d89-4a66-baaf-29c2aede3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf 1073741824 Jul 07 22:46:28 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5528b0-3433-4c41-9944-f1303a4fbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Volume volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 (8882fba6-07b2-4c78-910c-40b6b8aa5c16): created successfully Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5528b0-3433-4c41-9944-f1303a4fbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (d42f12af-7345-4582-8210-d9ad0f24fffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fa53eba1-bd8e-4725-b9e7-231cb388c99d tempest-CreateVolumesFromImageTest-1149488022 None] Created volume successfully. Jul 07 22:46:29 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf 1073741824" returned: 0 in 1.073s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:30 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf Jul 07 22:46:30 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:31 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf" returned: 0 in 1.034s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.892s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225088028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f885bb-5f7f-4021-8431-46aeab37aa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:27Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Creating volume a0f885bb-5f7f-4021-8431-46aeab37aa64 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:31 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:31 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 1073741824 Jul 07 22:46:31 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e664730-c4ec-49bb-94b1-7941fbab7786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c407510-2844-487c-b6dd-697d84f664bf', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052ca462-9d2d-4c12-bfbf-1e1a463f3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:31 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Volume volume-1c407510-2844-487c-b6dd-697d84f664bf (1c407510-2844-487c-b6dd-697d84f664bf): created successfully Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052ca462-9d2d-4c12-bfbf-1e1a463f3f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (da996a0c-0c59-46db-8a42-222e4c471384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-caddbf2c-9fa2-4c10-9135-f43fa91caea2 tempest-CreateVolumesFromImageTest-1149488022 None] Created volume successfully. Jul 07 22:46:32 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 1073741824" returned: 0 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:32 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 Jul 07 22:46:32 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:33 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64" returned: 0 in 0.934s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.181s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-716616927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06be7620-9a68-4ddb-ab70-f8fa494b206a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:28Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Creating volume 06be7620-9a68-4ddb-ab70-f8fa494b206a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:33 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:33 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a 1073741824 Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f3643-db86-4504-8878-e96b974113d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f885bb-5f7f-4021-8431-46aeab37aa64', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:33 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c84183-4a00-47af-8223-6b88dc58deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:33 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Volume volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 (a0f885bb-5f7f-4021-8431-46aeab37aa64): created successfully Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c84183-4a00-47af-8223-6b88dc58deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:33 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (166c2d9a-e301-41a5-a251-6a86abaf858b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-93f269f3-1d62-43a5-8f0d-de8c20094950 tempest-CreateVolumesFromImageTest-1149488022 None] Created volume successfully. Jul 07 22:46:34 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a 1073741824" returned: 0 in 1.127s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:34 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a Jul 07 22:46:34 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:34 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a" returned: 0 in 0.703s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.141s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272670964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8b784d-07b5-4d61-bc99-45cea62eb6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4199be81064d178a7af1100e8457b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:28Z,use_quota=True,user_id='ef0da23df9314f9c89c8436eecf6f2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Creating volume ac8b784d-07b5-4d61-bc99-45cea62eb6ae {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:34 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6316d19-ca36-462c-99f3-0e99d6b06b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06be7620-9a68-4ddb-ab70-f8fa494b206a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10e1dd-0e59-47e2-8c89-98fa499e77d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:34 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae 1073741824 Jul 07 22:46:34 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Volume volume-06be7620-9a68-4ddb-ab70-f8fa494b206a (06be7620-9a68-4ddb-ab70-f8fa494b206a): created successfully Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10e1dd-0e59-47e2-8c89-98fa499e77d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (4aa537d2-c793-45ba-8f53-b0f3cf6dc11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-be7b2f81-6fe3-4a0d-a404-239506a6602e tempest-CreateVolumesFromImageTest-1149488022 None] Created volume successfully. Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5897470-8b28-496d-9dd6-fe08fe510272 tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" by "attach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5897470-8b28-496d-9dd6-fe08fe510272 tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" acquired by "attach_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=11 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5897470-8b28-496d-9dd6-fe08fe510272 tempest-VolumesActionsTest-1390037247 None] Attaching volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb to instance 8edbdfce-fb07-4c1a-aea6-a26573724dae at mountpoint /dev/vdb on host None. Jul 07 22:46:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d5897470-8b28-496d-9dd6-fe08fe510272 tempest-VolumesActionsTest-1390037247 None] Attach volume completed successfully. Jul 07 22:46:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d5897470-8b28-496d-9dd6-fe08fe510272 tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" released by "attach_volume" :: held 0.159s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:36 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae 1073741824" returned: 0 in 1.347s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8458e9ab-21a8-432f-b457-dd03316d3fa7 tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" by "detach_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8458e9ab-21a8-432f-b457-dd03316d3fa7 tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8458e9ab-21a8-432f-b457-dd03316d3fa7 tempest-VolumesActionsTest-1390037247 None] Detaching volume 85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb from instance 8edbdfce-fb07-4c1a-aea6-a26573724dae. Jul 07 22:46:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:36 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae Jul 07 22:46:36 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8458e9ab-21a8-432f-b457-dd03316d3fa7 tempest-VolumesActionsTest-1390037247 None] Detach volume completed successfully. Jul 07 22:46:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8458e9ab-21a8-432f-b457-dd03316d3fa7 tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-detach_volume" released by "detach_volume" :: held 0.174s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:37 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" returned: 0 in 0.960s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.468s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-561275874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2108ad1-dcf1-4a64-b3a6-596791f63aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122839f45eb6407b9f2aae8233c27cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:29Z,use_quota=True,user_id='f38dd09d444445a88b1682445961e4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Creating volume c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:46:37 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264a02f6-7bae-43cf-85d9-ce486760c567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b89bc97-dbbd-4007-8fd3-41a442364773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:37 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa 1073741824 Jul 07 22:46:37 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Volume volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae (ac8b784d-07b5-4d61-bc99-45cea62eb6ae): created successfully Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b89bc97-dbbd-4007-8fd3-41a442364773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Flow 'volume_create_manager' (49518f2e-aaa7-40e7-8df9-2e6cda6410e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-123a0ed0-533b-484c-9c31-14d85fcd3e5c tempest-CreateVolumesFromImageTest-1149488022 None] Created volume successfully. Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-ac8b784d-07b5-4d61-bc99-45cea62eb6ae-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-ac8b784d-07b5-4d61-bc99-45cea62eb6ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-quobyte-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af79b1a-2227-471d-bdf6-6d66de2d1214]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:38 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae Jul 07 22:46:38 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:38 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa 1073741824" returned: 0 in 1.329s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:38 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:46:38 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:38 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" returned: 0 in 1.052s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:39 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae Jul 07 22:46:39 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:39 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 0.998s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badf1958-10eb-4f9b-9d1a-ac8df643ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578143a6-1a12-4b79-8580-45607e403dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:39 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Volume volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa (c2108ad1-dcf1-4a64-b3a6-596791f63aaa): created successfully Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578143a6-1a12-4b79-8580-45607e403dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:39 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Flow 'volume_create_manager' (2e0e2ca3-aa08-4618-9d73-47a54c9597a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-de97d516-a298-452b-a86b-ac7bc308e152 tempest-VolumesCloneTest-76706302 None] Created volume successfully. Jul 07 22:46:40 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" returned: 0 in 1.076s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-ac8b784d-07b5-4d61-bc99-45cea62eb6ae" released by "delete_volume" :: held 2.185s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Created reservations ['b952d470-0ed4-4bc9-b729-ea20c3220270', 'f1f3cd49-27ea-460f-a426-46e0b9606ccd', '5d5d9efa-93d2-45de-b9bf-e4e6d7400adb', '27b41d10-928b-4aa6-ad77-ff65e3f1038a'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:40 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:40 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:40 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.675s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Deleted volume successfully. Jul 07 22:46:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4388410d-69db-4b28-87fd-e6b0529e2c0c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-ac8b784d-07b5-4d61-bc99-45cea62eb6ae-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-06be7620-9a68-4ddb-ab70-f8fa494b206a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-06be7620-9a68-4ddb-ab70-f8fa494b206a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-quobyte-06be7620-9a68-4ddb-ab70-f8fa494b206a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-06be7620-9a68-4ddb-ab70-f8fa494b206a" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d50b7-436c-402e-b984-d1b60ff64914]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Flow 'volume_create_manager' (3fc1acfe-5e9b-4219-80f6-36c390b64abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c5e4de-c49b-4dad-b10d-6fa4d8bee9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c5e4de-c49b-4dad-b10d-6fa4d8bee9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-608767458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6102e60a-7778-4420-8eeb-90f24d4f11c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122839f45eb6407b9f2aae8233c27cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c2108ad1-dcf1-4a64-b3a6-596791f63aaa,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:41Z,use_quota=True,user_id='f38dd09d444445a88b1682445961e4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37df3c7b-fa81-4e1f-a3b2-25d9e42e6b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:41 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a Jul 07 22:46:41 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37df3c7b-fa81-4e1f-a3b2-25d9e42e6b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fdcb70-35a5-408f-a915-05a30528c753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fdcb70-35a5-408f-a915-05a30528c753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6102e60a-7778-4420-8eeb-90f24d4f11c3', 'volume_name': 'volume-6102e60a-7778-4420-8eeb-90f24d4f11c3', 'volume_size': 2, 'source_volid': 'c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'source_volstatus': 'available'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae4b499-daf6-4f60-a38c-0dd952bc9be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae4b499-daf6-4f60-a38c-0dd952bc9be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f6b0df-2cd5-468a-a4ad-94c5fa0437dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Volume 6102e60a-7778-4420-8eeb-90f24d4f11c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6102e60a-7778-4420-8eeb-90f24d4f11c3', 'volume_size': 2, 'source_volid': 'c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'source_volstatus': 'available'} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Cloning volume c2108ad1-dcf1-4a64-b3a6-596791f63aaa to volume 6102e60a-7778-4420-8eeb-90f24d4f11c3 Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Creating offline snapshot fd92f271-ecb1-4ef7-9984-0a5a912e1af7 of volume c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a5d2d-a8c1-4bf0-bb07-b97491b735e8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:41 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:46:41 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:42 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:42 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a Jul 07 22:46:42 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:42 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 0.925s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:42 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 1G Jul 07 22:46:42 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:42 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06be7620-9a68-4ddb-ab70-f8fa494b206a" returned: 0 in 0.682s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-06be7620-9a68-4ddb-ab70-f8fa494b206a" released by "delete_volume" :: held 1.660s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:42 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Created reservations ['7a9b11dd-92d2-4c0a-babc-2018bc903c04', 'abbdd627-72ff-4873-bfeb-689f036708d5', '1b38cb20-8cf4-4956-b587-fd1b0954177d', 'b281ac60-7424-417e-a766-3a24cf963335'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:43 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:43 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:43 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 1G" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:43 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:43 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-a0f885bb-5f7f-4021-8431-46aeab37aa64-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-a0f885bb-5f7f-4021-8431-46aeab37aa64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-quobyte-a0f885bb-5f7f-4021-8431-46aeab37aa64" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-a0f885bb-5f7f-4021-8431-46aeab37aa64" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e22606-3506-40ee-a248-a7eab0c7c162]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:43 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 Jul 07 22:46:43 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:43 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Deleted volume successfully. Jul 07 22:46:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-279311bd-e0f6-46ae-ad8f-a0ee57bb87c1 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-06be7620-9a68-4ddb-ab70-f8fa494b206a-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:44 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.960s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:44 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 is being set with open permissions: ugo+rw Jul 07 22:46:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:44 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:44 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:44 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64" returned: 0 in 0.858s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:44 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64 Jul 07 22:46:44 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:45 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.756s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:45 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info Jul 07 22:46:45 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:45 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a0f885bb-5f7f-4021-8431-46aeab37aa64" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-a0f885bb-5f7f-4021-8431-46aeab37aa64" released by "delete_volume" :: held 1.749s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Created reservations ['0ca4b086-d335-440f-a7e3-46cb80d9983e', '14999204-b1b1-4718-846c-a9ba609cb9d7', '5440eff6-2b5a-47e7-af6d-4b59fe510469', '6b70b5e5-c7ff-43ef-a7df-b1dc75161c96'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:45 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:45 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-1c407510-2844-487c-b6dd-697d84f664bf-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-1c407510-2844-487c-b6dd-697d84f664bf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-quobyte-1c407510-2844-487c-b6dd-697d84f664bf" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-1c407510-2844-487c-b6dd-697d84f664bf" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[abadc2a5-ba8b-497b-84c7-7af955d2968b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:46 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf Jul 07 22:46:46 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:46 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info" returned: 0 in 1.033s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:46 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info is being set with open permissions: ugo+rw Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:46 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info Jul 07 22:46:46 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:46 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.042s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Deleted volume successfully. Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbed0860-5e61-4f6e-9d2e-730d2448e05c tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-a0f885bb-5f7f-4021-8431-46aeab37aa64-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:47 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf" returned: 0 in 1.111s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:47 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf Jul 07 22:46:47 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:47 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.info" returned: 0 in 1.023s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] snapshot: fd92f271-ecb1-4ef7-9984-0a5a912e1af7, volume: 6102e60a-7778-4420-8eeb-90f24d4f11c3, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28fa57-a7c1-47d4-b923-a77f91dd4c29]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:47 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:47 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:47 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1c407510-2844-487c-b6dd-697d84f664bf" returned: 0 in 0.682s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-1c407510-2844-487c-b6dd-697d84f664bf" released by "delete_volume" :: held 1.866s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Created reservations ['baed85b4-bb8c-4c17-b678-8ee86a6ecce9', 'dd162a87-d473-4160-bd03-9647aaaed4b8', '3b632c2a-3acd-4903-8d86-960c004b7a0b', 'fc37b60e-92e4-4dac-b9b4-b18fa5f15592'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:47 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:47 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-8882fba6-07b2-4c78-910c-40b6b8aa5c16-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-8882fba6-07b2-4c78-910c-40b6b8aa5c16-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "cinder-quobyte-8882fba6-07b2-4c78-910c-40b6b8aa5c16" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-8882fba6-07b2-4c78-910c-40b6b8aa5c16" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a8907a-ddf0-4ba8-a56e-86285a9e3b26]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:48 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e80b1e-fde2-43d9-bd8c-75e2166481b2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:48 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 Jul 07 22:46:48 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:48 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:46:48 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:48 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.698s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Deleted volume successfully. Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a5e44067-b4a5-45a5-a66c-dcc14f371792 tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-1c407510-2844-487c-b6dd-697d84f664bf-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:48 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:48 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16 Jul 07 22:46:48 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:48 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:49 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 Jul 07 22:46:49 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:49 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8882fba6-07b2-4c78-910c-40b6b8aa5c16" returned: 0 in 0.660s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-quobyte-8882fba6-07b2-4c78-910c-40b6b8aa5c16" released by "delete_volume" :: held 1.550s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Created reservations ['a8a804b5-2b4d-4901-a45f-ff57f6389dbc', 'da73ea36-4b2a-4e7b-8b06-a38da6b9ca5b', '1e8c20c4-8d26-49ac-939b-68b2e8d9d616', '0f33c93b-0560-4092-bd87-6d83cd582bff'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:49 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:46:49 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:51 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:51 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Deleted volume successfully. Jul 07 22:46:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fee450eb-7ed0-43e5-9198-cfe81aad983b tempest-CreateVolumesFromImageTest-1149488022 None] Lock "cinder-8882fba6-07b2-4c78-910c-40b6b8aa5c16-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:54 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3" returned: 0 in 5.678s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b991e-5167-4274-b5a9-9946b54d48d1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:54 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:46:54 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:55 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 0.954s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:55 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:46:55 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Converted 1024.00 MB image at 180.31 MB/s Jul 07 22:46:55 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 is being set with open permissions: ugo+rw Jul 07 22:46:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:55 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 Jul 07 22:46:55 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=101,cinder:SELECT=74,cinder:INSERT=22,cinder:DELETE=10 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (4b2f9da1-e9d0-4ad7-82d2-06e06ef2722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaafbb2-56d4-406d-aad8-689d363b54ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaafbb2-56d4-406d-aad8-689d363b54ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671432734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a6bb2f-8428-4e4e-b727-bf8a45982270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2295cc-6467-4400-9bc0-696990163c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2295cc-6467-4400-9bc0-696990163c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d40f30e-9693-4797-8700-6bee174526a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d40f30e-9693-4797-8700-6bee174526a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a6bb2f-8428-4e4e-b727-bf8a45982270', 'volume_name': 'volume-11a6bb2f-8428-4e4e-b727-bf8a45982270', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e05d1fb-9993-4310-9b25-add9efe49365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e05d1fb-9993-4310-9b25-add9efe49365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6face9f9-e3a3-4c11-bbbb-e6c83c94f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume 11a6bb2f-8428-4e4e-b727-bf8a45982270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a6bb2f-8428-4e4e-b727-bf8a45982270', 'volume_size': 1} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:56 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3" returned: 0 in 0.667s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" released by "_copy_volume_from_snapshot" :: held 9.099s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-quobyte-fd92f271-ecb1-4ef7-9984-0a5a912e1af7" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-fd92f271-ecb1-4ef7-9984-0a5a912e1af7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Deleting offline snapshot fd92f271-ecb1-4ef7-9984-0a5a912e1af7 of volume c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] snapshot_file for this snap is: volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4744a1-9609-4836-a8d8-1fd3203b8b0e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:56 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:56 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:57 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.758s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9adb8-e3b8-4625-b413-e954987b69b4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:57 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:46:57 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:57 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 0.747s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:57 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:57 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:58 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.791s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:58 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7 Jul 07 22:46:58 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:59 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa.fd92f271-ecb1-4ef7-9984-0a5a912e1af7" returned: 0 in 0.637s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-fd92f271-ecb1-4ef7-9984-0a5a912e1af7" released by "_delete_snapshot" :: held 3.044s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.942s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 12.629s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f6b0df-2cd5-468a-a4ad-94c5fa0437dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6102e60a-7778-4420-8eeb-90f24d4f11c3', 'volume_size': 2, 'source_volid': 'c2108ad1-dcf1-4a64-b3a6-596791f63aaa', 'source_volstatus': 'available'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2798f5b4-7230-454f-95a8-6a27f79031fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64dd648-fd07-4d43-b3a0-23d2c0d441f6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Volume volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 (6102e60a-7778-4420-8eeb-90f24d4f11c3): created successfully Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2798f5b4-7230-454f-95a8-6a27f79031fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Flow 'volume_create_manager' (3fc1acfe-5e9b-4219-80f6-36c390b64abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e5c57666-5a98-4816-be23-5dbcf4c77f1a tempest-VolumesCloneTest-76706302 None] Created volume successfully. Jul 07 22:46:59 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:46:59 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-6102e60a-7778-4420-8eeb-90f24d4f11c3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "cinder-6102e60a-7778-4420-8eeb-90f24d4f11c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:00 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[961afa7c-5988-4477-8e8c-eec2d2d364e8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb70854-35fd-4130-963a-4ac3de77f5bf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:00 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:00 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:00 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 Jul 07 22:47:00 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:01 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3" returned: 0 in 0.819s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:01 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.858s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.51313a9c-46fa-4ed5-a675-9abac2c9ea74nnr6d655.img {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:01 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3 Jul 07 22:47:01 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:01 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.51313a9c-46fa-4ed5-a675-9abac2c9ea74nnr6d655.img Jul 07 22:47:01 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:02 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6102e60a-7778-4420-8eeb-90f24d4f11c3" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-6102e60a-7778-4420-8eeb-90f24d4f11c3" released by "delete_volume" :: held 1.683s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Created reservations ['c3922654-877e-49e2-8d77-5b61358d4cda', 'fa696ff5-98c4-4922-9177-0245ba288647', 'f2fa51de-cc1d-4126-af86-e591e324e994', '00060f90-c16f-49a1-9a90-76ce052a4b88'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:02 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:02 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-c2108ad1-dcf1-4a64-b3a6-596791f63aaa-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "cinder-c2108ad1-dcf1-4a64-b3a6-596791f63aaa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Acquiring lock "cinder-quobyte-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" acquired by "delete_volume" :: waited 0.044s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38749ff-2905-436e-836f-56280b05344e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:04 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:47:04 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:05 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 2.746s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:05 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Deleted volume successfully. Jul 07 22:47:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-07a92168-332b-4bb0-bb14-03edc8f2e383 tempest-VolumesCloneTest-76706302 None] Lock "cinder-6102e60a-7778-4420-8eeb-90f24d4f11c3-delete_volume" released by "delete_volume" :: held 4.930s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:06 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 2.586s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:06 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa Jul 07 22:47:06 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:07 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" returned: 0 in 1.607s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "cinder-quobyte-c2108ad1-dcf1-4a64-b3a6-596791f63aaa" released by "delete_volume" :: held 4.393s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Created reservations ['7886f055-8ebb-47f7-ae43-ec53a2f12dfd', 'a9f9665c-e1a1-4db1-bbc3-fd5b9efe7e9c', 'df613f64-5e29-49e6-bcfd-a788fa7167bd', 'a4e17fbd-b436-4d86-9baf-9834d18ccea5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:07 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.51313a9c-46fa-4ed5-a675-9abac2c9ea74nnr6d655.img" returned: 0 in 6.667s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f553935-e897-4f00-a5e6-3f4d27e4be23]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:07 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:07 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:08 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:08 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-c00fda92-feee-43e5-b585-7064c487477d req-ba641ecb-c759-4612-8d2d-fb1e132c1cfd tempest-TestShelveInstance-370936860 None] Terminate volume connection completed successfully. Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-c00fda92-feee-43e5-b585-7064c487477d req-ba641ecb-c759-4612-8d2d-fb1e132c1cfd tempest-TestShelveInstance-370936860 None] Deleting attachment 0e9cf83f-7083-47b6-ad12-a6cb06537dbc. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:47:08 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.692s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Deleted volume successfully. Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-093ce5f7-a1ba-4676-a2fe-bf4f0d0a73ed tempest-VolumesCloneTest-76706302 None] Lock "cinder-c2108ad1-dcf1-4a64-b3a6-596791f63aaa-delete_volume" released by "delete_volume" :: held 5.489s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:08 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.994s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.51313a9c-46fa-4ed5-a675-9abac2c9ea74nnr6d655.img {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:47:08 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Converted 1024.00 MB image at 153.57 MB/s Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] 51313a9c-46fa-4ed5-a675-9abac2c9ea74 was raw, no need to convert to raw {{(pid=88087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Acquiring lock "cinder-e57fb563-a6fa-4bec-8bc4-38defdef0831-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "cinder-e57fb563-a6fa-4bec-8bc4-38defdef0831-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Acquiring lock "cinder-quobyte-e57fb563-a6fa-4bec-8bc4-38defdef0831" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "cinder-quobyte-e57fb563-a6fa-4bec-8bc4-38defdef0831" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b926277-921a-49a2-b6b1-426f26de3a99]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:09 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:47:09 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:10 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 0.965s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:10 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:47:10 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:10 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 1 in 0.924s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:11 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831 Jul 07 22:47:11 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:11 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-e57fb563-a6fa-4bec-8bc4-38defdef0831" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "cinder-quobyte-e57fb563-a6fa-4bec-8bc4-38defdef0831" released by "delete_volume" :: held 2.818s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:11 devstack cinder-volume[88087]: DEBUG cinder.quota [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Created reservations ['1cc4f036-f933-4d21-b2a5-4629fdf529e9', '6b5f0373-b310-46ad-a9f2-0bfb69096cea', 'bd0eb619-6003-4a8c-b989-a8fe1816007e', '3e208577-d18d-4abf-875e-3533196bb4df'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:12 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:12 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Flow 'volume_create_manager' (f1503abf-de72-4fa3-89ab-980306cc80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7dae81-dd56-4022-b62c-871b7f7ccbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7dae81-dd56-4022-b62c-871b7f7ccbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079055349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca3c43f-fd2a-4a74-9565-84856ef4aeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5461c9b9fab7495d991094c6ab2f0f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:12Z,use_quota=True,user_id='c87459d5ef6144da88fc89e1c913be89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc5c6a6-42e8-4f27-997c-290c077e2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc5c6a6-42e8-4f27-997c-290c077e2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bedef4-7c90-47c9-98e4-0d29a300f99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bedef4-7c90-47c9-98e4-0d29a300f99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca3c43f-fd2a-4a74-9565-84856ef4aeac', 'volume_name': 'volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac', 'volume_size': 2}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959746c6-8208-492c-b3d8-91c3aa32b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959746c6-8208-492c-b3d8-91c3aa32b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d9fc0d-1ec2-4166-830f-f5aca7062e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Volume 5ca3c43f-fd2a-4a74-9565-84856ef4aeac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac', 'volume_size': 2} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:12 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.894s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.manager [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Deleted volume successfully. Jul 07 22:47:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [req-c00fda92-feee-43e5-b585-7064c487477d req-072a2d11-d744-4291-9b5f-5da50288afdb tempest-TestShelveInstance-370936860 None] Lock "cinder-e57fb563-a6fa-4bec-8bc4-38defdef0831-delete_volume" released by "delete_volume" :: held 3.994s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:15 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:15 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:16 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.855s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:47:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:47:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:47:22 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=3,cinder:SELECT=18 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:47:22 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=61,cinder:UPDATE=80,cinder:INSERT=21,cinder:DELETE=5 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Flow 'volume_create_manager' (8a8e4e98-dc28-42e0-a025-61b37d231820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8bf050-4ee0-4564-ae15-a8708c536128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8bf050-4ee0-4564-ae15-a8708c536128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484145619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db3af45-353c-40d9-a546-ec0f3116078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee24509db5c4a1d9fc09d12e07c5309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:28Z,use_quota=True,user_id='964e5995323e41c5afcf44c7e361cdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46017581-d9e8-4d73-b9fd-137f8c7fff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46017581-d9e8-4d73-b9fd-137f8c7fff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03711096-016e-4eb2-9fac-ff7bd32150d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03711096-016e-4eb2-9fac-ff7bd32150d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db3af45-353c-40d9-a546-ec0f3116078b', 'volume_name': 'volume-2db3af45-353c-40d9-a546-ec0f3116078b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66727d27-dfee-49d8-bde3-42fc0fadac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66727d27-dfee-49d8-bde3-42fc0fadac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2196de-f27e-4e96-ac42-44ac4d4cc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Volume 2db3af45-353c-40d9-a546-ec0f3116078b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db3af45-353c-40d9-a546-ec0f3116078b', 'volume_size': 1} Jul 07 22:47:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.361s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Uploaded volume to glance image-id: 51313a9c-46fa-4ed5-a675-9abac2c9ea74. {{(pid=88087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.621s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671432734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a6bb2f-8428-4e4e-b727-bf8a45982270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume 11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:30 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:30 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 1073741824 Jul 07 22:47:30 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b7394858-9966-493f-a64a-2b4804987bef tempest-VolumesActionsTest-1390037247 None] Copy volume to image completed successfully. Jul 07 22:47:31 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 1073741824" returned: 0 in 0.914s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:31 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 Jul 07 22:47:31 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:32 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270" returned: 0 in 0.696s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.185s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1079055349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca3c43f-fd2a-4a74-9565-84856ef4aeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5461c9b9fab7495d991094c6ab2f0f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:12Z,use_quota=True,user_id='c87459d5ef6144da88fc89e1c913be89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Creating volume 5ca3c43f-fd2a-4a74-9565-84856ef4aeac {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:32 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac 2147483648 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6face9f9-e3a3-4c11-bbbb-e6c83c94f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a6bb2f-8428-4e4e-b727-bf8a45982270', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:32 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac 2147483648 Jul 07 22:47:32 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea50ecf8-82ee-4c35-b707-e0c106752011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 (11a6bb2f-8428-4e4e-b727-bf8a45982270): created successfully Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea50ecf8-82ee-4c35-b707-e0c106752011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (4b2f9da1-e9d0-4ad7-82d2-06e06ef2722c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:32 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7f256565-145e-4ed4-8822-672aa5118fe7 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:47:33 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac 2147483648" returned: 0 in 0.879s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:33 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac Jul 07 22:47:33 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:34 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.860s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484145619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db3af45-353c-40d9-a546-ec0f3116078b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee24509db5c4a1d9fc09d12e07c5309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:28Z,use_quota=True,user_id='964e5995323e41c5afcf44c7e361cdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Creating volume 2db3af45-353c-40d9-a546-ec0f3116078b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:34 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:34 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b 1073741824 Jul 07 22:47:34 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d9fc0d-1ec2-4166-830f-f5aca7062e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac', 'volume_size': 2}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a6572-8bee-4e75-a20d-5c5048d76893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Volume volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac (5ca3c43f-fd2a-4a74-9565-84856ef4aeac): created successfully Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a6572-8bee-4e75-a20d-5c5048d76893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Flow 'volume_create_manager' (f1503abf-de72-4fa3-89ab-980306cc80ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-75fe55fd-3c1f-484d-bcd6-b9d805172c95 tempest-VolumesCloneNegativeTest-112040161 None] Created volume successfully. Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Acquiring lock "cinder-5ca3c43f-fd2a-4a74-9565-84856ef4aeac-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "cinder-5ca3c43f-fd2a-4a74-9565-84856ef4aeac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Acquiring lock "cinder-quobyte-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "cinder-quobyte-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f2102-b61a-426d-9184-6903479a836d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:35 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac Jul 07 22:47:35 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:35 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b 1073741824" returned: 0 in 0.970s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:35 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b Jul 07 22:47:35 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:35 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" returned: 0 in 0.782s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:35 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b" returned: 0 in 0.678s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:35 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac Jul 07 22:47:35 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.746s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74abd5a-7814-45d8-83bf-3427e5f1c1a9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:35 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:35 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2196de-f27e-4e96-ac42-44ac4d4cc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db3af45-353c-40d9-a546-ec0f3116078b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef33be3-5162-45ec-804f-75f77435296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Volume volume-2db3af45-353c-40d9-a546-ec0f3116078b (2db3af45-353c-40d9-a546-ec0f3116078b): created successfully Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef33be3-5162-45ec-804f-75f77435296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Flow 'volume_create_manager' (8a8e4e98-dc28-42e0-a025-61b37d231820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-34eef50d-e566-4325-8d4e-af83dc64ab98 tempest-ProjectReaderTests-1977719940 None] Created volume successfully. Jul 07 22:47:36 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "cinder-quobyte-5ca3c43f-fd2a-4a74-9565-84856ef4aeac" released by "delete_volume" :: held 1.593s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Created reservations ['b59e97aa-bec8-467f-bbc6-c640d207e5e4', '5a6766e3-d0b1-484f-9961-7bee4f648017', '289f4740-0a59-4963-b613-60503c30806f', '98b4dc39-9a66-479d-a4d4-6d012063d622'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:36 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.906s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:36 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:36 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe009d2-d541-4eff-a401-bb185335f305]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:36 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:36 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Acquiring lock "cinder-2db3af45-353c-40d9-a546-ec0f3116078b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "cinder-2db3af45-353c-40d9-a546-ec0f3116078b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Acquiring lock "cinder-quobyte-2db3af45-353c-40d9-a546-ec0f3116078b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "cinder-quobyte-2db3af45-353c-40d9-a546-ec0f3116078b" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60875c8-7f45-42c4-8c34-60df33f44994]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:37 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b Jul 07 22:47:37 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:37 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.787s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Deleted volume successfully. Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6285cdf5-526c-48c5-9d70-f3115e8916ed tempest-VolumesCloneNegativeTest-112040161 None] Lock "cinder-5ca3c43f-fd2a-4a74-9565-84856ef4aeac-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:37 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.888s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:37 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img Jul 07 22:47:37 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:37 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:37 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b Jul 07 22:47:37 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:38 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2db3af45-353c-40d9-a546-ec0f3116078b" returned: 0 in 1.103s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "cinder-quobyte-2db3af45-353c-40d9-a546-ec0f3116078b" released by "delete_volume" :: held 2.071s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Created reservations ['77790dfc-3fef-4e97-af6c-f6086f3d79ea', '46f56734-e597-4ced-a50f-63ae538e8d1d', '28d8b3c4-47c6-4a0d-b74c-826b58a00e56', '58238903-cb9d-40f9-8e85-af908053270d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:39 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:39 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:41 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.793s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:41 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Deleted volume successfully. Jul 07 22:47:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ec994f78-d449-411a-9a6b-0ec2d3e07f8e tempest-ProjectReaderTests-1977719940 None] Lock "cinder-2db3af45-353c-40d9-a546-ec0f3116078b-delete_volume" released by "delete_volume" :: held 4.585s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Flow 'volume_create_manager' (08a4772f-3511-4216-88ff-bc502dd89f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f15aa1-1eb3-4681-8af8-e3fae9bc8706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f15aa1-1eb3-4681-8af8-e3fae9bc8706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556816363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3090577-827c-412f-b6b3-92ccb7f002c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee24509db5c4a1d9fc09d12e07c5309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:42Z,use_quota=True,user_id='964e5995323e41c5afcf44c7e361cdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f793672-3f01-4d6c-9f5b-f4c5b1821b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f793672-3f01-4d6c-9f5b-f4c5b1821b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6c0ba3-4d77-4188-90cf-914df2bcd025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6c0ba3-4d77-4188-90cf-914df2bcd025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3090577-827c-412f-b6b3-92ccb7f002c8', 'volume_name': 'volume-f3090577-827c-412f-b6b3-92ccb7f002c8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6540a939-9136-4d4b-b243-e5e01a52d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6540a939-9136-4d4b-b243-e5e01a52d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491cf9f7-d082-49c5-ad84-d4832b7cddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Volume f3090577-827c-412f-b6b3-92ccb7f002c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3090577-827c-412f-b6b3-92ccb7f002c8', 'volume_size': 1} Jul 07 22:47:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:43 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img" returned: 0 in 6.169s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[425543be-a6bc-42f4-a6ee-58d3eba19b41]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Flow 'volume_create_manager' (6ec0b6ce-5ba9-44f8-af5d-3526663b5790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36156cf0-9784-4660-bc04-c3b7d642e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:43 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:43 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36156cf0-9784-4660-bc04-c3b7d642e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1414506301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dc1273-fe96-409c-b04d-8b1cfc523802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9409ffa50c934b39bc73d7da3881a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:44Z,use_quota=True,user_id='4b2d60a2e62947e7bc0f2cab21ad9c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df955d9-1507-492d-a6ba-a97596138c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df955d9-1507-492d-a6ba-a97596138c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6402c73f-a65d-4571-8c17-b3b541c62890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6402c73f-a65d-4571-8c17-b3b541c62890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dc1273-fe96-409c-b04d-8b1cfc523802', 'volume_name': 'volume-c5dc1273-fe96-409c-b04d-8b1cfc523802', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98486aa3-3830-44d9-90c2-811faa9e34ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98486aa3-3830-44d9-90c2-811faa9e34ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e38edd-693f-45c3-8f2a-930256cf7a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Volume c5dc1273-fe96-409c-b04d-8b1cfc523802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dc1273-fe96-409c-b04d-8b1cfc523802', 'volume_size': 1} Jul 07 22:47:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:44 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 1.033s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:44 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:47:44 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Converted 1024.00 MB image at 165.95 MB/s Jul 07 22:47:44 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] 72754f63-117e-44d6-a177-641a987cd815 was raw, converting to qcow2 {{(pid=88087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 22:47:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cd3a4-6de1-4d24-894a-a9be6dab3bb9]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:44 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img Jul 07 22:47:44 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:45 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:45 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img Jul 07 22:47:45 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:46 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img" returned: 1 in 0.724s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:47:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:46 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq Jul 07 22:47:46 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:47 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq" returned: 0 in 0.628s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:47 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Image conversion details: src /opt/stack/data/cinder/conversion/85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb.temp_image.72754f63-117e-44d6-a177-641a987cd8157hwzlnvv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:47:47 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 22:47:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a339ec1-784d-4302-90b8-8d925fe8c550]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:47 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq Jul 07 22:47:47 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:47 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34wqoeyq" returned: 0 in 0.703s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.429s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Uploaded volume to glance image-id: 72754f63-117e-44d6-a177-641a987cd815. {{(pid=88087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.482s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating offline snapshot bb69417b-f4b8-4c5b-ab5a-3e1bd078043d of volume 11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:47:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-27634d2f-8b8c-4e0f-9eb6-8e7baffa337d tempest-VolumesActionsTest-1390037247 None] Copy volume to image completed successfully. Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57787d-c29f-46d6-93ad-5bf4bfc73fa5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:49 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 Jul 07 22:47:49 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:50 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:50 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d 1G Jul 07 22:47:50 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Acquiring lock "cinder-quobyte-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "cinder-quobyte-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[962abf44-7fd9-4067-a540-3a30713e2ec7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:50 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:50 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:50 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d 1G" returned: 0 in 0.880s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:51 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d Jul 07 22:47:51 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:51 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:51 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb Jul 07 22:47:51 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:51 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:51 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d is being set with open permissions: ugo+rw Jul 07 22:47:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:51 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d Jul 07 22:47:51 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:52 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" returned: 0 in 0.660s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:52 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "cinder-quobyte-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb" released by "delete_volume" :: held 1.760s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:52 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info Jul 07 22:47:52 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Created reservations ['cd86f0d1-88fe-416c-8b24-261faaf88e77', 'd32e901c-d04c-414b-8ff9-fc20eef07c1d', '74279dd8-98e8-4c45-8fdf-b2662daca784', 'cd0be9b8-11a8-49d7-97d0-84295fb25ecf'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:52 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:52 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:53 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info" returned: 0 in 0.684s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:53 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info is being set with open permissions: ugo+rw Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:53 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info Jul 07 22:47:53 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:53 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Deleted volume successfully. Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7ee0bfcc-0834-458a-b3be-b29935e887cc tempest-VolumesActionsTest-1390037247 None] Lock "cinder-85bf7def-cf9d-4dc1-a9f8-91f8da77c0cb-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:53 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.info" returned: 0 in 0.766s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.662s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.614s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556816363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3090577-827c-412f-b6b3-92ccb7f002c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee24509db5c4a1d9fc09d12e07c5309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:42Z,use_quota=True,user_id='964e5995323e41c5afcf44c7e361cdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Creating volume f3090577-827c-412f-b6b3-92ccb7f002c8 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:53 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 1073741824 Jul 07 22:47:53 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ca2bc1d6-48a3-4b96-8caa-d5dc29781bd3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Create snapshot completed successfully Jul 07 22:47:55 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 1073741824" returned: 0 in 1.165s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:55 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 Jul 07 22:47:55 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (f05ca85c-5823-4fb2-a615-3c60bf5d4c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9073aa3f-3e68-4244-96bf-c8add9b6ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9073aa3f-3e68-4244-96bf-c8add9b6ba63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477136658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4365de49-5690-40f5-b162-732d1d6387be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:55Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f486f2-cf44-4366-820f-77002eb54fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f486f2-cf44-4366-820f-77002eb54fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c4ddb-e3d4-4f01-8e95-e528c1bb22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c4ddb-e3d4-4f01-8e95-e528c1bb22ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4365de49-5690-40f5-b162-732d1d6387be', 'volume_name': 'volume-4365de49-5690-40f5-b162-732d1d6387be', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d05c5d2-481f-4cca-94e4-d2557d313857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d05c5d2-481f-4cca-94e4-d2557d313857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b11a03-7d45-4934-a9d6-88fe8ab87e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume 4365de49-5690-40f5-b162-732d1d6387be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4365de49-5690-40f5-b162-732d1d6387be', 'volume_size': 1} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (88981553-c514-4f79-8881-4dab5ec32ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0a6e9b-a334-4fb5-938d-fa048cb356de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0a6e9b-a334-4fb5-938d-fa048cb356de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374915099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8604215-70d0-48fb-b10d-be1384b58a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e6c5d-61b0-4496-bae7-6f738d838ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e6c5d-61b0-4496-bae7-6f738d838ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f419da8e-e047-40e2-b035-bb9dceaa406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f419da8e-e047-40e2-b035-bb9dceaa406a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8604215-70d0-48fb-b10d-be1384b58a6d', 'volume_name': 'volume-b8604215-70d0-48fb-b10d-be1384b58a6d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d5619c-ea30-44c0-af57-ac8505bcf95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d5619c-ea30-44c0-af57-ac8505bcf95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4187e1b-0746-4eda-801c-f54d312b05d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume b8604215-70d0-48fb-b10d-be1384b58a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8604215-70d0-48fb-b10d-be1384b58a6d', 'volume_size': 1} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8" returned: 0 in 0.872s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.991s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1414506301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dc1273-fe96-409c-b04d-8b1cfc523802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9409ffa50c934b39bc73d7da3881a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:44Z,use_quota=True,user_id='4b2d60a2e62947e7bc0f2cab21ad9c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Creating volume c5dc1273-fe96-409c-b04d-8b1cfc523802 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:55 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:56 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 1073741824 Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491cf9f7-d082-49c5-ad84-d4832b7cddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3090577-827c-412f-b6b3-92ccb7f002c8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1872bd61-bf17-42dd-9f2d-cc5c484e2aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Volume volume-f3090577-827c-412f-b6b3-92ccb7f002c8 (f3090577-827c-412f-b6b3-92ccb7f002c8): created successfully Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1872bd61-bf17-42dd-9f2d-cc5c484e2aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Flow 'volume_create_manager' (08a4772f-3511-4216-88ff-bc502dd89f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1f00c570-ed22-49f0-946e-0290abcaced2 tempest-ProjectReaderTests-1977719940 None] Created volume successfully. Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (fc8b2a1a-229b-4ba9-b430-e9ec9f01039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4e60e4-e794-41d4-aeb7-436436715e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4e60e4-e794-41d4-aeb7-436436715e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624950129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8518db46-e198-4957-8296-0aae52e03b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03149f24-3601-4599-9e96-156bc7cf9a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03149f24-3601-4599-9e96-156bc7cf9a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1a066a-18d2-40d2-ba18-0b1a01651e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1a066a-18d2-40d2-ba18-0b1a01651e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8518db46-e198-4957-8296-0aae52e03b1b', 'volume_name': 'volume-8518db46-e198-4957-8296-0aae52e03b1b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e4443f-7744-4221-910c-685be2740c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e4443f-7744-4221-910c-685be2740c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad9cd3-9ecd-47b8-a140-4c78dc4895bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume 8518db46-e198-4957-8296-0aae52e03b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8518db46-e198-4957-8296-0aae52e03b1b', 'volume_size': 1} Jul 07 22:47:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "cinder-f3090577-827c-412f-b6b3-92ccb7f002c8-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "cinder-f3090577-827c-412f-b6b3-92ccb7f002c8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (d4122ef2-30dd-4365-9003-06e7e2531c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c54793-075f-4cc4-8fdd-748e992ca386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c54793-075f-4cc4-8fdd-748e992ca386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739599003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97304b87-8c3e-41b2-96c1-67c581e8c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:57Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10308fb-c1b0-4836-aa5a-0a94b88e83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10308fb-c1b0-4836-aa5a-0a94b88e83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0242f953-62bd-4f3e-8ce7-5193e4d7364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0242f953-62bd-4f3e-8ce7-5193e4d7364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97304b87-8c3e-41b2-96c1-67c581e8c96e', 'volume_name': 'volume-97304b87-8c3e-41b2-96c1-67c581e8c96e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad50d0f-f5de-4fa9-bba3-f350a9d64ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad50d0f-f5de-4fa9-bba3-f350a9d64ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4da8bb-cb99-4c2d-acb8-9f1cdd9e6d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume 97304b87-8c3e-41b2-96c1-67c581e8c96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97304b87-8c3e-41b2-96c1-67c581e8c96e', 'volume_size': 1} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "cinder-quobyte-f3090577-827c-412f-b6b3-92ccb7f002c8" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "cinder-quobyte-f3090577-827c-412f-b6b3-92ccb7f002c8" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[848800fb-99a4-42b5-95db-0af0a3360745]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:57 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 1073741824" returned: 0 in 1.371s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:57 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 Jul 07 22:47:57 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:57 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 Jul 07 22:47:57 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (46f237c1-c33d-4f35-8a5b-7e20580597cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7389068d-7a53-4a38-b79c-d17354e0965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7389068d-7a53-4a38-b79c-d17354e0965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310660933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d92fef-bf3e-4bf4-a461-96561c340cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:58Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1e0c18-2237-469e-a7f4-b26c1d1ecff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1e0c18-2237-469e-a7f4-b26c1d1ecff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100c2804-8481-40c2-b205-cbc8172ae963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100c2804-8481-40c2-b205-cbc8172ae963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d92fef-bf3e-4bf4-a461-96561c340cb6', 'volume_name': 'volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3f3d7f-3a3a-4f9d-8506-6720f12d3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3f3d7f-3a3a-4f9d-8506-6720f12d3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6eb397-998a-4a5d-8f50-8905be66535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume b3d92fef-bf3e-4bf4-a461-96561c340cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6', 'volume_size': 1} Jul 07 22:47:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:58 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802" returned: 0 in 0.843s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.776s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477136658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4365de49-5690-40f5-b162-732d1d6387be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:55Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume 4365de49-5690-40f5-b162-732d1d6387be {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:58 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:58 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be 1073741824 Jul 07 22:47:58 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e38edd-693f-45c3-8f2a-930256cf7a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dc1273-fe96-409c-b04d-8b1cfc523802', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c9f98-22fa-476f-8f56-240ec1ff7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Volume volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 (c5dc1273-fe96-409c-b04d-8b1cfc523802): created successfully Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c9f98-22fa-476f-8f56-240ec1ff7aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Flow 'volume_create_manager' (6ec0b6ce-5ba9-44f8-af5d-3526663b5790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0e6ab9f9-6c8e-4956-a42c-7d6208e31f4c tempest-VolumesNegativeTest-1901946021 None] Created volume successfully. Jul 07 22:47:58 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8" returned: 0 in 1.251s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:58 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8 Jul 07 22:47:58 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:59 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3090577-827c-412f-b6b3-92ccb7f002c8" returned: 0 in 0.909s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "cinder-quobyte-f3090577-827c-412f-b6b3-92ccb7f002c8" released by "delete_volume" :: held 2.238s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:47:59 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be 1073741824" returned: 0 in 1.182s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Created reservations ['cbe13a79-e3b7-4387-b5ea-cc2bc744feba', '0e1029ce-441b-4259-b6c5-e2ee0bd66202', '099d04be-590f-429f-9686-fad5ead16886', '297de050-58d7-42fe-a3d4-7e55e436e7a1'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:59 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be Jul 07 22:47:59 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:59 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:47:59 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:00 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be" returned: 0 in 0.992s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.624s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374915099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8604215-70d0-48fb-b10d-be1384b58a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume b8604215-70d0-48fb-b10d-be1384b58a6d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:00 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:00 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.923s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:00 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d 1073741824 Jul 07 22:48:00 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b11a03-7d45-4934-a9d6-88fe8ab87e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4365de49-5690-40f5-b162-732d1d6387be', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1287510f-9cd1-40ba-92c7-275e67186bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Deleted volume successfully. Jul 07 22:48:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-4365de49-5690-40f5-b162-732d1d6387be (4365de49-5690-40f5-b162-732d1d6387be): created successfully Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1287510f-9cd1-40ba-92c7-275e67186bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (f05ca85c-5823-4fb2-a615-3c60bf5d4c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4f555e7e-331a-4961-8145-2548264dd707 tempest-ProjectReaderTests-1977719940 None] Lock "cinder-f3090577-827c-412f-b6b3-92ccb7f002c8-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1cedaf13-9469-4f85-893f-1e40acc9b05d tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Flow 'volume_create_manager' (52c21c68-4b65-41df-8a48-d3707d48b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b472ad-c680-478e-a708-ce8f7f1fae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b472ad-c680-478e-a708-ce8f7f1fae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-68389890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78268b0e-d1e1-4c00-8289-cba671ad49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa881a6a25f4fda9fa034e1963fe757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:02Z,use_quota=True,user_id='a2351b70eba546f886a1dc7bc8400761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42997bf4-d811-468f-beb6-6bd1ecbc6d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42997bf4-d811-468f-beb6-6bd1ecbc6d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27500d78-b22e-4ca2-8522-4a30e5aa45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:48:01 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d 1073741824" returned: 0 in 1.205s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:01 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d Jul 07 22:48:01 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27500d78-b22e-4ca2-8522-4a30e5aa45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78268b0e-d1e1-4c00-8289-cba671ad49af', 'volume_name': 'volume-78268b0e-d1e1-4c00-8289-cba671ad49af', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db45fa2-69d7-49b6-814c-7c9b472e4e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db45fa2-69d7-49b6-814c-7c9b472e4e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645be05c-7183-427e-9b63-7dc5fc12ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Volume 78268b0e-d1e1-4c00-8289-cba671ad49af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78268b0e-d1e1-4c00-8289-cba671ad49af', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Trying to clone 78268b0e-d1e1-4c00-8289-cba671ad49af from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:48:02 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.249s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624950129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8518db46-e198-4957-8296-0aae52e03b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:56Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume 8518db46-e198-4957-8296-0aae52e03b1b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:02 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:02 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b 1073741824 Jul 07 22:48:02 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4187e1b-0746-4eda-801c-f54d312b05d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8604215-70d0-48fb-b10d-be1384b58a6d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb8ea01-33fd-4779-a06e-502051af9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:48:02 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:48:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-b8604215-70d0-48fb-b10d-be1384b58a6d (b8604215-70d0-48fb-b10d-be1384b58a6d): created successfully Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb8ea01-33fd-4779-a06e-502051af9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (88981553-c514-4f79-8881-4dab5ec32ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ab31fb8a-60f7-4c4b-8ae6-5ee22ed18de3 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575d82f-ae73-4373-af4a-f83a3afccbc9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:03 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD Jul 07 22:48:03 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:03 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b 1073741824" returned: 0 in 0.978s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:03 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 is fetched for user a2351b70eba546f886a1dc7bc8400761. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:48:03 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b Jul 07 22:48:03 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeea519-baa0-4a78-a6c0-73e0560d10ec]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:04 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD Jul 07 22:48:04 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:04 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b" returned: 0 in 0.697s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.344s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739599003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97304b87-8c3e-41b2-96c1-67c581e8c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:57Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume 97304b87-8c3e-41b2-96c1-67c581e8c96e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:04 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:04 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e 1073741824 Jul 07 22:48:04 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ad9cd3-9ecd-47b8-a140-4c78dc4895bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8518db46-e198-4957-8296-0aae52e03b1b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d875650-bcaf-4933-a41e-2a803bf517b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-8518db46-e198-4957-8296-0aae52e03b1b (8518db46-e198-4957-8296-0aae52e03b1b): created successfully Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d875650-bcaf-4933-a41e-2a803bf517b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (fc8b2a1a-229b-4ba9-b430-e9ec9f01039d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-338a1d19-0b14-4096-9527-265ebae4ec51 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:48:04 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:05 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e 1073741824" returned: 0 in 0.931s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:05 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e Jul 07 22:48:05 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:06 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.446s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310660933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d92fef-bf3e-4bf4-a461-96561c340cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe7d6c8b8354952aa2366ed0758f4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:58Z,use_quota=True,user_id='fe481e3743d34ecca9a51e50610a209a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Creating volume b3d92fef-bf3e-4bf4-a461-96561c340cb6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:06 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:06 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 1073741824 Jul 07 22:48:06 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4da8bb-cb99-4c2d-acb8-9f1cdd9e6d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97304b87-8c3e-41b2-96c1-67c581e8c96e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cacce3-0cd1-40b1-ad8a-6ebbb84ae383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-97304b87-8c3e-41b2-96c1-67c581e8c96e (97304b87-8c3e-41b2-96c1-67c581e8c96e): created successfully Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cacce3-0cd1-40b1-ad8a-6ebbb84ae383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (d4122ef2-30dd-4365-9003-06e7e2531c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c55d7c44-72d8-4873-a4e0-9bf719fb2ae4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:48:07 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 1073741824" returned: 0 in 0.968s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:07 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 Jul 07 22:48:07 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:08 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-68389890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78268b0e-d1e1-4c00-8289-cba671ad49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa881a6a25f4fda9fa034e1963fe757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:02Z,use_quota=True,user_id='a2351b70eba546f886a1dc7bc8400761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Creating volume 78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:08 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6eb397-998a-4a5d-8f50-8905be66535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141227d0-792b-4196-87b9-25c039fc10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:08 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1073741824 Jul 07 22:48:08 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Volume volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 (b3d92fef-bf3e-4bf4-a461-96561c340cb6): created successfully Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141227d0-792b-4196-87b9-25c039fc10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Flow 'volume_create_manager' (46f237c1-c33d-4f35-8a5b-7e20580597cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7ec7df5d-7e4c-43b4-8959-467613bb6e30 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created volume successfully. Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-b3d92fef-bf3e-4bf4-a461-96561c340cb6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-b3d92fef-bf3e-4bf4-a461-96561c340cb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-b3d92fef-bf3e-4bf4-a461-96561c340cb6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-b3d92fef-bf3e-4bf4-a461-96561c340cb6" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a43063-a76f-4b3f-8ff1-f8fa8e1b587d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:09 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 Jul 07 22:48:09 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:09 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1073741824" returned: 0 in 0.936s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:09 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:09 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:09 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6" returned: 0 in 0.865s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:09 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6 Jul 07 22:48:09 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:09 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 0.777s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Attempting download of bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume 78268b0e-d1e1-4c00-8289-cba671ad49af. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2487cda-52f8-4572-8852-266f0e16560b]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:10 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8 Jul 07 22:48:10 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:10 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3d92fef-bf3e-4bf4-a461-96561c340cb6" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-b3d92fef-bf3e-4bf4-a461-96561c340cb6" released by "delete_volume" :: held 1.598s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['dd11bd95-05ba-48f2-baf9-455b9b405c09', '5cd76f28-1a39-4554-803a-afb461d25fe4', '50fcd034-dc18-4aa9-afc6-9f3326a9fabb', 'a7755313-f716-47b0-a2c8-79e7218e6991'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:10 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:10 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:10 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8" returned: 0 in 0.940s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:11 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8 Jul 07 22:48:11 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-97304b87-8c3e-41b2-96c1-67c581e8c96e-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-97304b87-8c3e-41b2-96c1-67c581e8c96e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-97304b87-8c3e-41b2-96c1-67c581e8c96e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-97304b87-8c3e-41b2-96c1-67c581e8c96e" acquired by "delete_volume" :: waited 0.072s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace8430b-e1b1-4673-b28c-ee861626f16f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:11 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e Jul 07 22:48:11 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:11 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.101s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d010f427-fdea-4c17-b6a5-09588b179817 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-b3d92fef-bf3e-4bf4-a461-96561c340cb6-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:12 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8" returned: 1 in 1.173s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_859l5dw8' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91f3911-280e-4e43-b17d-7e57cd04acc7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:12 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD Jul 07 22:48:12 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:12 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e" returned: 0 in 1.097s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:12 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e Jul 07 22:48:12 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:12 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 was qcow2, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:48:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:12 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:12 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:13 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-97304b87-8c3e-41b2-96c1-67c581e8c96e" returned: 0 in 0.779s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-97304b87-8c3e-41b2-96c1-67c581e8c96e" released by "delete_volume" :: held 2.033s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['c3b7cca7-2df5-4a91-a684-b2a465867a2b', '4371e28e-1550-4953-9be3-181a24fea1c2', '5b83d9d6-f9e3-481a-b7ac-1dea62201788', 'b9c308ab-8621-423f-9b2c-cf2648058c23'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:13 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:13 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:14 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.901s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:14 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9958d839-ea8f-47a0-9cab-9c77958aadf4 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-97304b87-8c3e-41b2-96c1-67c581e8c96e-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-8518db46-e198-4957-8296-0aae52e03b1b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-8518db46-e198-4957-8296-0aae52e03b1b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-8518db46-e198-4957-8296-0aae52e03b1b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-8518db46-e198-4957-8296-0aae52e03b1b" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb6ac0-9f24-4835-a798-b73df3455d50]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:14 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b Jul 07 22:48:14 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:15 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:15 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:15 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 2.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb7be1ca-6cd5-4484-a2ea-4c7ab5296617_lcyvnlatdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:48:15 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Converted 112.00 MB image at 41.18 MB/s Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:15 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1G Jul 07 22:48:15 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:15 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b" returned: 0 in 1.377s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:16 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b Jul 07 22:48:16 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:16 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.184s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:48:16 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 1G" returned: 0 in 1.221s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:16 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8518db46-e198-4957-8296-0aae52e03b1b" returned: 0 in 0.923s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-8518db46-e198-4957-8296-0aae52e03b1b" released by "delete_volume" :: held 2.375s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776b950-12de-46b8-8b3d-ff2158592e27]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['eee4776a-ecaf-4c4a-a1c5-749cda0e4671', '55ba16e9-021b-4136-8a02-dfc884e51e61', 'e0af091f-dcc6-42f0-b0e9-b30d78fcdcd7', '8f01eb38-70a8-4ba8-83f9-c17b16b92ee2'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:17 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:17 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:17 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:17 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:17 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 0.906s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:17 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.755s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-57deafdc-6a8a-4b74-9c1c-7211855d128e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-8518db46-e198-4957-8296-0aae52e03b1b-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-b8604215-70d0-48fb-b10d-be1384b58a6d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-b8604215-70d0-48fb-b10d-be1384b58a6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:18 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:18 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-b8604215-70d0-48fb-b10d-be1384b58a6d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-b8604215-70d0-48fb-b10d-be1384b58a6d" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b314564c-0c2e-4c27-8e9b-7df01ecc2f38]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:18 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d Jul 07 22:48:18 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:18 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 1 in 0.975s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Downloaded image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}])) to volume 78268b0e-d1e1-4c00-8289-cba671ad49af successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Temporary image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 for user a2351b70eba546f886a1dc7bc8400761 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Marking volume 78268b0e-d1e1-4c00-8289-cba671ad49af as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Copying metadata from image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 to 78268b0e-d1e1-4c00-8289-cba671ad49af. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:48:18 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Creating volume glance metadata for volume 78268b0e-d1e1-4c00-8289-cba671ad49af backed by image bb7be1ca-6cd5-4484-a2ea-4c7ab5296617 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:48:19 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d" returned: 0 in 0.941s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:19 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d Jul 07 22:48:19 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645be05c-7183-427e-9b63-7dc5fc12ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78268b0e-d1e1-4c00-8289-cba671ad49af', 'volume_size': 1, 'image_id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6820d144d29948fe927e9864c3f732bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb7be1ca-6cd5-4484-a2ea-4c7ab5296617', 'created_at': datetime.datetime(2026, 7, 7, 20, 25, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 25, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb7be1ca-6cd5-4484-a2ea-4c7ab5296617/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab83f55-4034-47d6-a9cf-f064f6dda505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Volume volume-78268b0e-d1e1-4c00-8289-cba671ad49af (78268b0e-d1e1-4c00-8289-cba671ad49af): created successfully Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab83f55-4034-47d6-a9cf-f064f6dda505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Flow 'volume_create_manager' (52c21c68-4b65-41df-8a48-d3707d48b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c08f5168-b3f4-482a-b62a-7054d80ff711 tempest-VolumesExtendTest-1826381912 None] Created volume successfully. Jul 07 22:48:20 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b8604215-70d0-48fb-b10d-be1384b58a6d" returned: 0 in 0.919s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-b8604215-70d0-48fb-b10d-be1384b58a6d" released by "delete_volume" :: held 1.920s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['81bbc086-5412-4751-9dbe-c9ff492edef6', '9fddb966-576a-436c-b192-a1c439cbdb24', '26ac7dfa-15c2-4fc8-99cd-a783736b5835', 'e23804fb-051b-4b8a-91b5-72e99c2760b7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:20 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:20 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-4365de49-5690-40f5-b162-732d1d6387be-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-4365de49-5690-40f5-b162-732d1d6387be-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-4365de49-5690-40f5-b162-732d1d6387be" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-4365de49-5690-40f5-b162-732d1d6387be" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ade426-79a9-4fdb-bd37-ec65155029ab]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe25922-c012-4d3c-97a1-256cf5671e79]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:20 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be Jul 07 22:48:20 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:20 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:20 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:21 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9b3d6e6b-deeb-4ac4-8f94-3dcf692d0b9e tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-b8604215-70d0-48fb-b10d-be1384b58a6d-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:21 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be" returned: 0 in 0.892s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:21 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be Jul 07 22:48:21 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:21 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 0.875s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:21 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:21 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:22 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4365de49-5690-40f5-b162-732d1d6387be" returned: 0 in 0.688s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-4365de49-5690-40f5-b162-732d1d6387be" released by "delete_volume" :: held 1.643s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['ee518e3e-dff9-4ed8-a248-e894f74ed03f', 'a3d142d2-3713-40cc-bd8e-78dbe9308bd7', '30291098-f724-4112-b4b9-9a1595951996', 'f6f5ab1f-e5e6-4e9a-8928-b1c323cd9f11'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=110,cinder:SELECT=80,cinder:DELETE=13,cinder:INSERT=31 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:22 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 1 in 0.839s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 2G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:22 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:22 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af 2G" returned: 0 in 0.082s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.868s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ffecc18a-37c6-48c3-aaea-c2fe3611bd77 tempest-VolumesExtendTest-1826381912 None] Extend volume completed successfully. Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleting offline snapshot bb69417b-f4b8-4c5b-ab5a-3e1bd078043d of volume 11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] snapshot_file for this snap is: volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e81b294-1a11-4ff6-b48f-ef0246dbb616]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:22 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d Jul 07 22:48:22 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-78268b0e-d1e1-4c00-8289-cba671ad49af-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-78268b0e-d1e1-4c00-8289-cba671ad49af-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:23 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=81,cinder:UPDATE=106,cinder:INSERT=30,cinder:DELETE=7 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.713s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d17fca2b-3798-4e8c-a373-92a828a428f9 tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-4365de49-5690-40f5-b162-732d1d6387be-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-quobyte-78268b0e-d1e1-4c00-8289-cba671ad49af" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-78268b0e-d1e1-4c00-8289-cba671ad49af" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[044f8f53-c3ae-48ae-a2f8-ea00762bb39f]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:23 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:23 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:23 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" returned: 0 in 0.871s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11a6bb2f-8428-4e4e-b727-bf8a45982270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[285082fb-00d1-46de-b939-4d48eda612c8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:23 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 Jul 07 22:48:23 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:24 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 0.831s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:24 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:24 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:24 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270" returned: 0 in 0.902s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:24 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d Jul 07 22:48:24 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:24 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 1 in 0.846s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:24 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af Jul 07 22:48:24 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:25 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" returned: 0 in 0.850s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:25 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d Jul 07 22:48:25 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:25 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-78268b0e-d1e1-4c00-8289-cba671ad49af" returned: 0 in 0.806s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-78268b0e-d1e1-4c00-8289-cba671ad49af" released by "delete_volume" :: held 2.570s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Created reservations ['f1b025a4-e991-428a-8d1b-c36077670bc4', 'e6fafa3b-4aef-48ba-8166-a22c68c03090', '95b896db-9844-4761-977e-058f1317638b', '251a47b6-ef33-47b1-b502-f4ff2748f84d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:25 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:25 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:26 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270.bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" returned: 0 in 0.764s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d" released by "_delete_snapshot" :: held 3.544s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" released by "delete_snapshot" :: held 3.574s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['a4ead7b4-c436-4b6d-bc2f-be405c290ed5', '1c01d4cd-c31a-411b-8ab0-3ad2499fd450', '65484d47-05f2-422b-93e3-8a6ef3ccc218', '7c152b4a-7150-4cb6-95eb-c94faec2fc99'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Delete snapshot completed successfully. Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c16f82da-cccd-4d26-85d9-d42d00b20b7a tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-bb69417b-f4b8-4c5b-ab5a-3e1bd078043d-delete_snapshot" released by "delete_snapshot" :: held 3.807s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:26 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Deleted volume successfully. Jul 07 22:48:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a9933fcd-ad5f-40ee-a4f2-783381902571 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-78268b0e-d1e1-4c00-8289-cba671ad49af-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-11a6bb2f-8428-4e4e-b727-bf8a45982270-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-11a6bb2f-8428-4e4e-b727-bf8a45982270-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c1cf9-41d4-43eb-929b-d08ae3fd41e2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Flow 'volume_create_manager' (a2af3e3e-6584-45c6-b31f-5700444c957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68b5c7c-569e-4510-b30c-460a1bed8624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68b5c7c-569e-4510-b30c-460a1bed8624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-635697773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd9ac45-25a7-4c39-a73d-6a8bd411012d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa881a6a25f4fda9fa034e1963fe757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:27Z,use_quota=True,user_id='a2351b70eba546f886a1dc7bc8400761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8602282-2242-4fda-ad16-63dc9fd8a9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8602282-2242-4fda-ad16-63dc9fd8a9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797c3892-362f-4cd3-b663-f6fe195440d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797c3892-362f-4cd3-b663-f6fe195440d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd9ac45-25a7-4c39-a73d-6a8bd411012d', 'volume_name': 'volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75344e86-4e94-4c98-a922-06a9c7499ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75344e86-4e94-4c98-a922-06a9c7499ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de2a0a5-12d4-44b9-9832-d96639e9f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Volume 7bd9ac45-25a7-4c39-a73d-6a8bd411012d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d', 'volume_size': 1} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-635697773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd9ac45-25a7-4c39-a73d-6a8bd411012d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa881a6a25f4fda9fa034e1963fe757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:27Z,use_quota=True,user_id='a2351b70eba546f886a1dc7bc8400761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Creating volume 7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:27 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 Jul 07 22:48:27 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:27 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:27 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d 1073741824 Jul 07 22:48:27 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:28 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270" returned: 0 in 0.939s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:28 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270 Jul 07 22:48:28 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:28 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d 1073741824" returned: 0 in 1.016s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:28 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:28 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:28 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11a6bb2f-8428-4e4e-b727-bf8a45982270" returned: 0 in 0.765s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-quobyte-11a6bb2f-8428-4e4e-b727-bf8a45982270" released by "delete_volume" :: held 1.793s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:28 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Created reservations ['0d140e97-df44-4532-b81b-98a73c8692d0', '7d526a92-a487-4136-af0d-08804b466708', 'a94f2939-8501-4665-ac3e-cc30d005a323', '34f55d57-3233-4295-b483-d800b6d02383'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:29 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:29 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:29 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de2a0a5-12d4-44b9-9832-d96639e9f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdca021a-f913-4096-8319-51b2341e34a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Volume volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d (7bd9ac45-25a7-4c39-a73d-6a8bd411012d): created successfully Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdca021a-f913-4096-8319-51b2341e34a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Flow 'volume_create_manager' (a2af3e3e-6584-45c6-b31f-5700444c957b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c438bdaf-581e-4708-a753-6870f8fa872e tempest-VolumesExtendTest-1826381912 None] Created volume successfully. Jul 07 22:48:29 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.839s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Deleted volume successfully. Jul 07 22:48:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8cb6e915-b04c-4976-9d0e-e9a21f55052c tempest-CreateVolumesFromSnapshotTest-2052905789 None] Lock "cinder-11a6bb2f-8428-4e4e-b727-bf8a45982270-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Creating offline snapshot aa287fb7-8a73-47fc-98e1-fb31a65063ad of volume 7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:48:30 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6942c10-2466-44cf-a576-37524dec198d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:30 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:30 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:31 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:31 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad 1G Jul 07 22:48:31 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Acquiring lock "cinder-c5dc1273-fe96-409c-b04d-8b1cfc523802-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:32 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "cinder-c5dc1273-fe96-409c-b04d-8b1cfc523802-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad 1G" returned: 0 in 1.016s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:32 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad Jul 07 22:48:32 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Acquiring lock "cinder-quobyte-c5dc1273-fe96-409c-b04d-8b1cfc523802" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "cinder-quobyte-c5dc1273-fe96-409c-b04d-8b1cfc523802" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b8288-ed11-4cd8-a8e5-87921bf314a4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:32 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 Jul 07 22:48:32 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:33 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad" returned: 0 in 0.790s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:33 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad is being set with open permissions: ugo+rw Jul 07 22:48:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:33 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad Jul 07 22:48:33 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:33 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802" returned: 0 in 0.852s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:33 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802 Jul 07 22:48:33 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:34 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad" returned: 0 in 0.699s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:34 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info Jul 07 22:48:34 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:34 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c5dc1273-fe96-409c-b04d-8b1cfc523802" returned: 0 in 0.753s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "cinder-quobyte-c5dc1273-fe96-409c-b04d-8b1cfc523802" released by "delete_volume" :: held 1.666s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Created reservations ['0de6ab8b-4c1a-41c7-bfbe-c385d077cd8e', '9a94eb9e-034a-45e6-b635-a17303167914', 'a159af02-0f23-4eda-af43-d9758fc1eeaa', '952640f0-b8c4-4c88-a054-33ef5e835245'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:34 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:34 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:34 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info" returned: 0 in 0.737s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:34 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info is being set with open permissions: ugo+rw Jul 07 22:48:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:34 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info Jul 07 22:48:34 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:35 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.748s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Deleted volume successfully. Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-572dd944-f078-48d7-b253-f0ce5a0cf2ed tempest-VolumesNegativeTest-1901946021 None] Lock "cinder-c5dc1273-fe96-409c-b04d-8b1cfc523802-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Flow 'volume_create_manager' (d99be1af-cc0a-4233-b1e0-a3981417a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:35 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461dd150-82b5-465c-b235-1be0e12c83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.info" returned: 0 in 0.920s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.216s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461dd150-82b5-465c-b235-1be0e12c83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df053fb-56ba-44bb-9858-6636c5a3ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5562f761cc364614bd1d3b5548422abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:36Z,use_quota=True,user_id='d838775290be4eb38a6f2a8d81150577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24058b1-c2ce-49b3-a512-dc859820be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24058b1-c2ce-49b3-a512-dc859820be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1772f9f-3d8b-47b1-b47d-a8f49c5a3795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:35 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:48:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f3ad49c5-f7cd-4c84-ac93-4fd3a06f2086 tempest-VolumesExtendTest-1826381912 None] Create snapshot completed successfully Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1772f9f-3d8b-47b1-b47d-a8f49c5a3795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7df053fb-56ba-44bb-9858-6636c5a3ebec', 'volume_name': 'volume-7df053fb-56ba-44bb-9858-6636c5a3ebec', 'volume_size': 1, 'image_id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '458c95c4943cfa8ae887929d76abcd7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5562f761cc364614bd1d3b5548422abd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8090081f3e9118d9ec427f02d5c163feea89677b09defd88372c35cbfb21edbd5ac338ff27de141ad18c482a3dcaa564d6cc8ae5398120fcd001eccc02734eb0', 'id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'created_at': datetime.datetime(2026, 7, 7, 20, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f62183-fa31-46b3-bd47-1750caf96df7/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd0545c-bbc6-4cd1-aa2a-7719e45c3698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd0545c-bbc6-4cd1-aa2a-7719e45c3698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b7fda-d2c3-4706-84c1-701826e6b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Volume 7df053fb-56ba-44bb-9858-6636c5a3ebec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7df053fb-56ba-44bb-9858-6636c5a3ebec', 'volume_size': 1, 'image_id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '458c95c4943cfa8ae887929d76abcd7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5562f761cc364614bd1d3b5548422abd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8090081f3e9118d9ec427f02d5c163feea89677b09defd88372c35cbfb21edbd5ac338ff27de141ad18c482a3dcaa564d6cc8ae5398120fcd001eccc02734eb0', 'id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'created_at': datetime.datetime(2026, 7, 7, 20, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f62183-fa31-46b3-bd47-1750caf96df7/file', 'properties': {}}, 'image_service': } Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Trying to clone 7df053fb-56ba-44bb-9858-6636c5a3ebec from image b2f62183-fa31-46b3-bd47-1750caf96df7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:48:36 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d36412d-ad2f-4019-a5d4-5e16c914d1c5]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:36 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:36 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912a902-16f7-4aa2-9c7d-6970675cd77a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:37 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:37 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:37 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:37 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:37 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:37 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.874s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad 2G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad 2G" returned: 0 in 0.160s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.088s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:38 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-91edf6a7-7856-4f94-9a28-672ad3a12f3b tempest-VolumesExtendTest-1826381912 None] Extend volume completed successfully. Jul 07 22:48:38 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Temporary image b2f62183-fa31-46b3-bd47-1750caf96df7 is fetched for user d838775290be4eb38a6f2a8d81150577. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[15439742-2443-48ac-8095-59f5ee2a60c5]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:38 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:38 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:39 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:39 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:39 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-aa287fb7-8a73-47fc-98e1-fb31a65063ad-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-aa287fb7-8a73-47fc-98e1-fb31a65063ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-quobyte-aa287fb7-8a73-47fc-98e1-fb31a65063ad" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-aa287fb7-8a73-47fc-98e1-fb31a65063ad" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Deleting offline snapshot aa287fb7-8a73-47fc-98e1-fb31a65063ad of volume 7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] snapshot_file for this snap is: volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e92d787-0eef-498c-9c5a-f3350ea6dce0]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:39 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad Jul 07 22:48:39 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:40 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df053fb-56ba-44bb-9858-6636c5a3ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5562f761cc364614bd1d3b5548422abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:36Z,use_quota=True,user_id='d838775290be4eb38a6f2a8d81150577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Creating volume 7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:48:40 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:40 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1073741824 Jul 07 22:48:40 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:40 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad" returned: 0 in 0.938s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1104056f-7a71-459c-945b-70f8b351dae5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:40 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:40 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:41 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1073741824" returned: 0 in 0.998s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:41 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:41 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:41 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:41 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad Jul 07 22:48:41 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:41 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:41 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Attempting download of b2f62183-fa31-46b3-bd47-1750caf96df7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}])) to volume 7df053fb-56ba-44bb-9858-6636c5a3ebec. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:48:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f37d89-a9a5-4504-8601-82e2e3d14de8]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:42 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln Jul 07 22:48:42 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:42 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad" returned: 0 in 0.902s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:42 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad Jul 07 22:48:42 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:43 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln" returned: 0 in 1.050s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:43 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln Jul 07 22:48:43 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:43 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d.aa287fb7-8a73-47fc-98e1-fb31a65063ad" returned: 0 in 0.850s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-aa287fb7-8a73-47fc-98e1-fb31a65063ad" released by "_delete_snapshot" :: held 3.837s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" released by "delete_snapshot" :: held 3.860s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Created reservations ['a4fd0c68-f315-46bf-a362-b2f0b02d11fd', '040a022f-4def-493f-8e5c-b4cc6ffd3493', '36a98e87-9bab-4320-bbed-07a2217c55e7', '2a09172f-06d3-4f85-947a-e12625ec42eb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Delete snapshot completed successfully. Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-86919db5-ab64-4f26-9cdd-54a640de09a8 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-aa287fb7-8a73-47fc-98e1-fb31a65063ad-delete_snapshot" released by "delete_snapshot" :: held 4.033s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-7bd9ac45-25a7-4c39-a73d-6a8bd411012d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-7bd9ac45-25a7-4c39-a73d-6a8bd411012d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d38b1-73b2-4f71-ae1c-ebedea048735]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:43 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln" returned: 1 in 0.878s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f62183-fa31-46b3-bd47-1750caf96df7_tjar8_ln' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[289d24c5-b188-489e-90a4-647e5d2bb84d]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:44 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:44 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:44 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:44 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:44 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:44 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.938s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:44 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d Jul 07 22:48:44 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:44 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD Jul 07 22:48:44 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:45 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:45 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD" returned: 1 in 1.007s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] b2f62183-fa31-46b3-bd47-1750caf96df7 was raw, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" returned: 0 in 0.928s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-quobyte-7bd9ac45-25a7-4c39-a73d-6a8bd411012d" released by "delete_volume" :: held 1.948s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:45 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:45 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:45 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Created reservations ['32f1ca39-c82f-4cac-9838-56a794149422', '2ee9f201-df15-4d22-a839-6033eccdac47', '4960d330-0643-4460-8b73-3afe08bbb998', 'a1bf4a73-118f-466a-9d77-3f93ea05a65c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:46 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:46 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:46 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 0 in 1.154s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2f62183-fa31-46b3-bd47-1750caf96df7_e8ei8xhodevstack@QuobyteHD, size 0.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:48:46 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:48:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:46 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1G Jul 07 22:48:46 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:47 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Deleted volume successfully. Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-749432db-5237-4bf9-8ee4-1c494712fb16 tempest-VolumesExtendTest-1826381912 None] Lock "cinder-7bd9ac45-25a7-4c39-a73d-6a8bd411012d-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:47 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec 1G" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd21f24-94c8-4ba7-ba8b-7f3c729cd6b3]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:47 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:47 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:48 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 0 in 0.831s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:48 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:48 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:49 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 1 in 0.945s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Downloaded image b2f62183-fa31-46b3-bd47-1750caf96df7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}])) to volume 7df053fb-56ba-44bb-9858-6636c5a3ebec successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Temporary image b2f62183-fa31-46b3-bd47-1750caf96df7 for user d838775290be4eb38a6f2a8d81150577 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Marking volume 7df053fb-56ba-44bb-9858-6636c5a3ebec as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Copying metadata from image b2f62183-fa31-46b3-bd47-1750caf96df7 to 7df053fb-56ba-44bb-9858-6636c5a3ebec. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Creating volume glance metadata for volume 7df053fb-56ba-44bb-9858-6636c5a3ebec backed by image b2f62183-fa31-46b3-bd47-1750caf96df7 with: {'image_id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '458c95c4943cfa8ae887929d76abcd7c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98b7fda-d2c3-4706-84c1-701826e6b516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df053fb-56ba-44bb-9858-6636c5a3ebec', 'volume_size': 1, 'image_id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f62183-fa31-46b3-bd47-1750caf96df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '458c95c4943cfa8ae887929d76abcd7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5562f761cc364614bd1d3b5548422abd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8090081f3e9118d9ec427f02d5c163feea89677b09defd88372c35cbfb21edbd5ac338ff27de141ad18c482a3dcaa564d6cc8ae5398120fcd001eccc02734eb0', 'id': 'b2f62183-fa31-46b3-bd47-1750caf96df7', 'created_at': datetime.datetime(2026, 7, 7, 20, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f62183-fa31-46b3-bd47-1750caf96df7/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5a52eb-b1a6-4096-85cc-2fc1a3e58ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:48:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Volume volume-7df053fb-56ba-44bb-9858-6636c5a3ebec (7df053fb-56ba-44bb-9858-6636c5a3ebec): created successfully Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5a52eb-b1a6-4096-85cc-2fc1a3e58ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:48:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Flow 'volume_create_manager' (d99be1af-cc0a-4233-b1e0-a3981417a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:48:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-01c7fa13-80ed-41cf-b88e-7f4943540026 tempest-VolumeImageDependencyTests-163215735 None] Created volume successfully. Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Acquiring lock "cinder-7df053fb-56ba-44bb-9858-6636c5a3ebec-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "cinder-7df053fb-56ba-44bb-9858-6636c5a3ebec-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Acquiring lock "cinder-quobyte-7df053fb-56ba-44bb-9858-6636c5a3ebec" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "cinder-quobyte-7df053fb-56ba-44bb-9858-6636c5a3ebec" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[760bfb64-61cf-4031-aebd-a520e45201f9]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:51 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:51 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:52 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 0 in 1.105s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:52 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:52 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:53 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 1 in 1.017s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:53 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec Jul 07 22:48:53 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:54 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7df053fb-56ba-44bb-9858-6636c5a3ebec" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "cinder-quobyte-7df053fb-56ba-44bb-9858-6636c5a3ebec" released by "delete_volume" :: held 3.028s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Created reservations ['22c5b4a9-7bb8-4667-b885-c608e21c019e', 'a9e7c851-5dc5-4d9e-b814-38bdeb646db7', '189efdbb-b20e-4eda-a000-ac7a723e5f42', 'f748d29e-d0b2-4a94-9a54-daaf93b3c8ea'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:54 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:48:54 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:55 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.863s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:55 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Deleted volume successfully. Jul 07 22:48:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0116c8dd-4dae-498e-95ee-d804b485fe7d tempest-VolumeImageDependencyTests-163215735 None] Lock "cinder-7df053fb-56ba-44bb-9858-6636c5a3ebec-delete_volume" released by "delete_volume" :: held 4.203s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=53,cinder:INSERT=21,cinder:UPDATE=57,cinder:DELETE=3 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Flow 'volume_create_manager' (3eecf0f4-b119-4f6b-8ec8-ccdbb6d3836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0776d03-d0c3-411a-a40c-8054b9d7e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0776d03-d0c3-411a-a40c-8054b9d7e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f487281-187e-4cf1-9331-4a35f2acdaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffe0d3f18484516ace10c5b62450ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:05Z,use_quota=True,user_id='5366c7eb4b0340f5abafa87b2b349aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db46c25-8cfb-45e1-9c60-a4b1a3fd0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db46c25-8cfb-45e1-9c60-a4b1a3fd0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba62bb-a538-4ce3-8437-5bf1c197f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba62bb-a538-4ce3-8437-5bf1c197f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f487281-187e-4cf1-9331-4a35f2acdaf6', 'volume_name': 'volume-1f487281-187e-4cf1-9331-4a35f2acdaf6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d67e68e-e6ba-499f-b382-7ba6d1f9a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d67e68e-e6ba-499f-b382-7ba6d1f9a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b248c7c2-ef00-40c5-a9dc-229e6a6abd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Volume 1f487281-187e-4cf1-9331-4a35f2acdaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f487281-187e-4cf1-9331-4a35f2acdaf6', 'volume_size': 1} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f487281-187e-4cf1-9331-4a35f2acdaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffe0d3f18484516ace10c5b62450ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:05Z,use_quota=True,user_id='5366c7eb4b0340f5abafa87b2b349aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Creating volume 1f487281-187e-4cf1-9331-4a35f2acdaf6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:04 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:49:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:04 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 1073741824 Jul 07 22:49:04 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:06 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 1073741824" returned: 0 in 1.441s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:06 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 Jul 07 22:49:06 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:07 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b248c7c2-ef00-40c5-a9dc-229e6a6abd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f487281-187e-4cf1-9331-4a35f2acdaf6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8683f97d-5413-4cf8-9f0d-d4439de4d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:07 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Volume volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 (1f487281-187e-4cf1-9331-4a35f2acdaf6): created successfully Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8683f97d-5413-4cf8-9f0d-d4439de4d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Flow 'volume_create_manager' (3eecf0f4-b119-4f6b-8ec8-ccdbb6d3836f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-086227bb-829b-437e-99c6-5b9f3a3e0bc7 tempest-CinderUnicodeTest-1306507034 None] Created volume successfully. Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Flow 'volume_create_manager' (028f9789-69bf-4fd8-9f73-c90c0bfea03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8eb636-037e-4b7d-8276-686939df9166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8eb636-037e-4b7d-8276-686939df9166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-737785607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06de7a49-29b0-45ab-92b6-c4b11c72b1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffe0d3f18484516ace10c5b62450ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:08Z,use_quota=True,user_id='5366c7eb4b0340f5abafa87b2b349aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d8c5de-237e-44af-9276-1f8d287789dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d8c5de-237e-44af-9276-1f8d287789dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93815c24-7cdf-49c3-854f-27b037bc7cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93815c24-7cdf-49c3-854f-27b037bc7cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06de7a49-29b0-45ab-92b6-c4b11c72b1bc', 'volume_name': 'volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f69880-bf68-4608-845d-6774ef54f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f69880-bf68-4608-845d-6774ef54f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c5e254-398f-4657-8ca1-78b98cb283d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Volume 06de7a49-29b0-45ab-92b6-c4b11c72b1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc', 'volume_size': 1} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-737785607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06de7a49-29b0-45ab-92b6-c4b11c72b1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffe0d3f18484516ace10c5b62450ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:08Z,use_quota=True,user_id='5366c7eb4b0340f5abafa87b2b349aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Creating volume 06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:08 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:49:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:08 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc 1073741824 Jul 07 22:49:08 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:09 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc 1073741824" returned: 0 in 1.085s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:09 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc Jul 07 22:49:09 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:10 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c5e254-398f-4657-8ca1-78b98cb283d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febf359-ce87-4a54-a30a-ff341505f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:10 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Volume volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc (06de7a49-29b0-45ab-92b6-c4b11c72b1bc): created successfully Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febf359-ce87-4a54-a30a-ff341505f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Flow 'volume_create_manager' (028f9789-69bf-4fd8-9f73-c90c0bfea03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d4bd01c3-3b24-45d2-b31a-79cb0e46c07c tempest-CinderUnicodeTest-1306507034 None] Created volume successfully. Jul 07 22:49:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Creating offline snapshot c57b264e-6248-425a-8e65-7bc952e6abb9 of volume 06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:49:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1b737-266a-45ac-a332-974f6bc3e4c6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:12 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc Jul 07 22:49:12 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:13 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:13 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 1G Jul 07 22:49:13 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:14 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 1G" returned: 0 in 0.946s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:14 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 Jul 07 22:49:14 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:15 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9" returned: 0 in 0.920s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:15 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 is being set with open permissions: ugo+rw Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:15 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 Jul 07 22:49:15 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:15 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:49:15 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:16 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9" returned: 0 in 1.116s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:16 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info Jul 07 22:49:16 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:16 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.068s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:49:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:49:17 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info" returned: 0 in 0.939s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:17 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info is being set with open permissions: ugo+rw Jul 07 22:49:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:17 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info Jul 07 22:49:17 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:18 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.info" returned: 0 in 0.837s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.893s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c6d64ec4-7916-4c73-860c-b1cb15faac0a tempest-CinderUnicodeTest-1306507034 None] Create snapshot completed successfully Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-c57b264e-6248-425a-8e65-7bc952e6abb9-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-c57b264e-6248-425a-8e65-7bc952e6abb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-quobyte-c57b264e-6248-425a-8e65-7bc952e6abb9" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-c57b264e-6248-425a-8e65-7bc952e6abb9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Deleting offline snapshot c57b264e-6248-425a-8e65-7bc952e6abb9 of volume 06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] snapshot_file for this snap is: volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6148b90e-431a-4b41-b117-a0d840e6536c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:18 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 Jul 07 22:49:18 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Flow 'volume_create_manager' (4955dfd2-399e-42e4-a559-939a8d74d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865c7d04-69bc-41ff-89d4-0ab982bfdda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865c7d04-69bc-41ff-89d4-0ab982bfdda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1585607064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef272825-6acb-49d9-b1bd-b7719f6274d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c394e53f9d44df995a3926b2884f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:20Z,use_quota=True,user_id='ac9df682fc8645ce9ab02f0e061a4339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813ffb55-14ce-4b44-a613-9c7588723b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813ffb55-14ce-4b44-a613-9c7588723b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906f0a11-9a82-4e02-a57c-216f9d823046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906f0a11-9a82-4e02-a57c-216f9d823046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef272825-6acb-49d9-b1bd-b7719f6274d3', 'volume_name': 'volume-ef272825-6acb-49d9-b1bd-b7719f6274d3', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27db2e28-53eb-4004-a29a-b7a900764c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27db2e28-53eb-4004-a29a-b7a900764c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41597e47-e0b4-4bfd-b06a-45ffd5cd5b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Volume ef272825-6acb-49d9-b1bd-b7719f6274d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef272825-6acb-49d9-b1bd-b7719f6274d3', 'volume_size': 1} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1585607064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef272825-6acb-49d9-b1bd-b7719f6274d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c394e53f9d44df995a3926b2884f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:20Z,use_quota=True,user_id='ac9df682fc8645ce9ab02f0e061a4339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Creating volume ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:19 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:19 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9" returned: 0 in 1.048s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:49:19 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 1073741824 Jul 07 22:49:19 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5a266c-5860-4274-b366-a0439a0c086d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:19 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc Jul 07 22:49:19 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:20 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" returned: 0 in 0.946s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:20 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 Jul 07 22:49:20 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:20 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 1073741824" returned: 0 in 1.272s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:21 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:49:21 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:21 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9" returned: 0 in 1.016s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:21 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9 Jul 07 22:49:21 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:21 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41597e47-e0b4-4bfd-b06a-45ffd5cd5b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef272825-6acb-49d9-b1bd-b7719f6274d3', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8158bfe8-3a27-4268-9979-b636eebeca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Volume volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 (ef272825-6acb-49d9-b1bd-b7719f6274d3): created successfully Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8158bfe8-3a27-4268-9979-b636eebeca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Flow 'volume_create_manager' (4955dfd2-399e-42e4-a559-939a8d74d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7f6fdbf4-6964-497d-8b05-972d6489c03c tempest-TestStampPattern-1922871812 None] Created volume successfully. Jul 07 22:49:22 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc.c57b264e-6248-425a-8e65-7bc952e6abb9" returned: 0 in 0.726s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=85,cinder:DELETE=8,cinder:SELECT=59,cinder:INSERT=20 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-c57b264e-6248-425a-8e65-7bc952e6abb9" released by "_delete_snapshot" :: held 3.856s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" released by "delete_snapshot" :: held 3.891s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Created reservations ['fed8a239-2f19-4250-b2f0-96da22394039', 'eb85f185-3236-4492-8e04-f3182bcddcc5', 'cfd874b3-c3f1-4f4b-86ef-005a1ef1e0ea', '9141ec4c-4a37-4c27-b851-e5dd432ddfec'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Delete snapshot completed successfully. Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-964ca271-d044-4e26-ac5c-170349f04a7d tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-c57b264e-6248-425a-8e65-7bc952e6abb9-delete_snapshot" released by "delete_snapshot" :: held 4.134s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-06de7a49-29b0-45ab-92b6-c4b11c72b1bc-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-06de7a49-29b0-45ab-92b6-c4b11c72b1bc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aec014-9008-4f10-81f8-cbd72f0ad29e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:23 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc Jul 07 22:49:23 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:24 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" returned: 0 in 0.924s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:24 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc Jul 07 22:49:24 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:24 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" returned: 0 in 0.687s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-06de7a49-29b0-45ab-92b6-c4b11c72b1bc" released by "delete_volume" :: held 1.694s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Created reservations ['1ab8450c-5033-4790-99e2-64f89ee17203', 'afef7f00-769c-47aa-8ae4-5dabbc96b223', 'edba2680-afa6-4e77-8505-1fca394a1e03', 'b4db5e35-d00a-4621-ab3e-acc7a3d8fd1d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:24 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:49:24 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-1f487281-187e-4cf1-9331-4a35f2acdaf6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-1f487281-187e-4cf1-9331-4a35f2acdaf6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "cinder-quobyte-1f487281-187e-4cf1-9331-4a35f2acdaf6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-1f487281-187e-4cf1-9331-4a35f2acdaf6" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d72ae0-3b48-4b33-bd6c-e057dda2cb50]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:25 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 Jul 07 22:49:25 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:25 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.786s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Deleted volume successfully. Jul 07 22:49:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4e43c2d6-9f18-4623-bc28-d99134336ff4 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-06de7a49-29b0-45ab-92b6-c4b11c72b1bc-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:26 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6" returned: 0 in 1.140s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:26 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6 Jul 07 22:49:26 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:27 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1f487281-187e-4cf1-9331-4a35f2acdaf6" returned: 0 in 1.356s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-quobyte-1f487281-187e-4cf1-9331-4a35f2acdaf6" released by "delete_volume" :: held 2.575s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:27 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Created reservations ['3496c4a2-6455-4cea-9092-38343aa67089', '8ddf203e-490b-4a1f-b4f8-0277bf9b84df', '50bdb440-a210-453b-80fb-09541ee4bc8f', '8dd24ff7-0961-4e8b-913f-673ac447b509'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:28 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:49:28 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:29 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.504s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:29 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Deleted volume successfully. Jul 07 22:49:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae01d0bc-8533-40bc-9acb-1dfba545a921 tempest-CinderUnicodeTest-1306507034 None] Lock "cinder-1f487281-187e-4cf1-9331-4a35f2acdaf6-delete_volume" released by "delete_volume" :: held 4.423s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:38 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=9 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:39 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Flow 'volume_create_manager' (95d56937-55b7-4ef5-a4e3-d389bf441666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f89d0e-d5e1-4572-8d06-a39e323f9472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f89d0e-d5e1-4572-8d06-a39e323f9472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-316618607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9785f8b6-dc37-4a5f-aee0-479219ed095d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af406550cdb4b9f93f3b958ec3d5c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:50Z,use_quota=True,user_id='38357fb821984a97a4758ae34d3f2e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00745a13-fa29-41f7-87e2-ca201aebbb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00745a13-fa29-41f7-87e2-ca201aebbb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd020f5-04d2-4a4d-acbf-de54de123ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd020f5-04d2-4a4d-acbf-de54de123ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9785f8b6-dc37-4a5f-aee0-479219ed095d', 'volume_name': 'volume-9785f8b6-dc37-4a5f-aee0-479219ed095d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c675cae-213b-46e7-a256-fea3283e59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c675cae-213b-46e7-a256-fea3283e59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093b0c1-bdb6-46de-a2d7-3589e96f990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:50 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Volume 9785f8b6-dc37-4a5f-aee0-479219ed095d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9785f8b6-dc37-4a5f-aee0-479219ed095d', 'volume_size': 1} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-316618607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9785f8b6-dc37-4a5f-aee0-479219ed095d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af406550cdb4b9f93f3b958ec3d5c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:50Z,use_quota=True,user_id='38357fb821984a97a4758ae34d3f2e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Creating volume 9785f8b6-dc37-4a5f-aee0-479219ed095d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:50 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:50 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d 1073741824 Jul 07 22:49:50 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:50 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d 1073741824" returned: 0 in 0.824s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:51 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d Jul 07 22:49:51 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:51 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d" returned: 0 in 0.643s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093b0c1-bdb6-46de-a2d7-3589e96f990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9785f8b6-dc37-4a5f-aee0-479219ed095d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d022e70-cb85-417c-826e-90aecf47eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Volume volume-9785f8b6-dc37-4a5f-aee0-479219ed095d (9785f8b6-dc37-4a5f-aee0-479219ed095d): created successfully Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d022e70-cb85-417c-826e-90aecf47eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Flow 'volume_create_manager' (95d56937-55b7-4ef5-a4e3-d389bf441666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f388abd1-a475-46ec-bc3a-7a97d400be61 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Created volume successfully. Jul 07 22:49:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3164d-3881-4e42-b927-6edc3b57c6fa]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:55 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d Jul 07 22:49:55 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:56 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-9785f8b6-dc37-4a5f-aee0-479219ed095d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70e1a401-aa87-48b3-afa4-6b9ba34bdc34', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:49:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-4be28012-d7ae-4289-ad58-4966f1799bf2 req-1d34b845-c243-49fd-b8b7-b80866a74404 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] attachment_update completed successfully. Jul 07 22:50:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-bd48238e-47b1-4c48-b296-a5d5e91891a0 req-9df5efbf-58a1-455a-a909-14a5b9f6af94 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Terminate volume connection completed successfully. Jul 07 22:50:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-bd48238e-47b1-4c48-b296-a5d5e91891a0 req-9df5efbf-58a1-455a-a909-14a5b9f6af94 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Deleting attachment 70e1a401-aa87-48b3-afa4-6b9ba34bdc34. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e06d578-6281-4b01-bdc9-65ddbdfe29f0]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "cinder-9785f8b6-dc37-4a5f-aee0-479219ed095d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "cinder-9785f8b6-dc37-4a5f-aee0-479219ed095d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:04 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:50:04 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "cinder-quobyte-9785f8b6-dc37-4a5f-aee0-479219ed095d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "cinder-quobyte-9785f8b6-dc37-4a5f-aee0-479219ed095d" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce7c13-0eb9-44d1-9c2d-adfaa8c3c9e1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:04 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d Jul 07 22:50:04 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:05 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.808s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-ef272825-6acb-49d9-b1bd-b7719f6274d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f025e0d2-9683-47d2-9d11-edc73a668a4f', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:50:05 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d Jul 07 22:50:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-2568c42b-3b33-4c4f-b41f-b8a58aa69d55 req-bbff86c0-32ea-430f-a444-0403aafd3b74 tempest-TestStampPattern-1922871812 None] attachment_update completed successfully. Jul 07 22:50:06 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9785f8b6-dc37-4a5f-aee0-479219ed095d" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "cinder-quobyte-9785f8b6-dc37-4a5f-aee0-479219ed095d" released by "delete_volume" :: held 1.543s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Created reservations ['314de4bb-7090-415a-a76a-b6072014a9d4', 'db232dce-daa3-46c3-b968-56cd2379387c', '5ec55aa4-bebf-40cb-a588-d4d993eb379c', 'af82ce3d-8582-4e20-b78c-aa64e36761ee'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:06 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:50:06 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:07 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.715s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:07 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Deleted volume successfully. Jul 07 22:50:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e955d4b8-299f-4512-9386-d9b781d45b23 tempest-TestServerVolumeAttachScenarioOldVersion-500828551 None] Lock "cinder-9785f8b6-dc37-4a5f-aee0-479219ed095d-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-89059c3c-3788-43e2-a23b-789fb1c39917 req-b3eb441c-0bd0-49f2-baca-6ab3ffdac953 tempest-TestStampPattern-1922871812 None] Terminate volume connection completed successfully. Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-89059c3c-3788-43e2-a23b-789fb1c39917 req-b3eb441c-0bd0-49f2-baca-6ab3ffdac953 tempest-TestStampPattern-1922871812 None] Deleting attachment f025e0d2-9683-47d2-9d11-edc73a668a4f. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:15 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:50:15 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:16 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.735s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:50:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:50:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:50:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Creating offline snapshot 9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 of volume ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:50:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0db774-18a5-4eac-81f2-0eb68787facc]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:17 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:50:17 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:18 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.826s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:18 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 1G Jul 07 22:50:18 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:19 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 1G" returned: 0 in 0.980s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:19 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:50:19 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:20 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 0.845s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:20 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 is being set with open permissions: ugo+rw Jul 07 22:50:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:20 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:50:20 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:20 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:20 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info Jul 07 22:50:20 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:21 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info" returned: 0 in 0.885s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:21 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info is being set with open permissions: ugo+rw Jul 07 22:50:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:21 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info Jul 07 22:50:21 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:22 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.info" returned: 0 in 0.670s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.998s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-79fb47e4-c974-4054-9979-7f668bb6c2c5 tempest-TestStampPattern-1922871812 None] Create snapshot completed successfully Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=24,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=3 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Flow 'volume_create_manager' (7e427ca2-625e-4c4b-b59b-6580b95ab928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c534b0-9e83-47d6-bf62-b616220b0cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c534b0-9e83-47d6-bf62-b616220b0cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1751815561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d42046c-6133-442a-9737-0e2f68e6d2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c394e53f9d44df995a3926b2884f22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:33Z,use_quota=True,user_id='ac9df682fc8645ce9ab02f0e061a4339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bfd74a-53d3-4792-89c8-f5d03c17a8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bfd74a-53d3-4792-89c8-f5d03c17a8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613684cf-0ee1-4670-8592-07341533356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613684cf-0ee1-4670-8592-07341533356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d42046c-6133-442a-9737-0e2f68e6d2a3', 'volume_name': 'volume-9d42046c-6133-442a-9737-0e2f68e6d2a3', 'volume_size': 1, 'snapshot_id': '9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f59ece-3504-4a86-89bc-63634feac02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f59ece-3504-4a86-89bc-63634feac02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a07941-55d7-4892-a570-125b7aedec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Volume 9d42046c-6133-442a-9737-0e2f68e6d2a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d42046c-6133-442a-9737-0e2f68e6d2a3', 'volume_size': 1, 'snapshot_id': '9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0'} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-9d42046c-6133-442a-9737-0e2f68e6d2a3" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-9d42046c-6133-442a-9737-0e2f68e6d2a3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Creating volume 9d42046c-6133-442a-9737-0e2f68e6d2a3 from snapshot 9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] snapshot: 9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0, volume: 9d42046c-6133-442a-9737-0e2f68e6d2a3, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[80394aaf-7b67-49af-be1a-86edf09900c8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:33 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:50:33 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:34 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 1.014s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef272825-6acb-49d9-b1bd-b7719f6274d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc60852-49a3-4e05-b494-e6f5096b82a3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:34 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:50:34 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:35 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 1.158s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:35 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:50:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:35 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 Jul 07 22:50:35 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:42 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3" returned: 0 in 6.853s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd0118-7972-487e-bc31-357ccba4810b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:42 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:50:42 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:42 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:43 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:43 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 1.447s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:43 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:50:43 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Converted 1024.00 MB image at 149.35 MB/s Jul 07 22:50:43 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 is being set with open permissions: ugo+rw Jul 07 22:50:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:43 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 Jul 07 22:50:43 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:44 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3" returned: 0 in 0.987s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" released by "_copy_volume_from_snapshot" :: held 11.622s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-9d42046c-6133-442a-9737-0e2f68e6d2a3" released by "_create_volume_from_snapshot" :: held 11.675s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.696s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a07941-55d7-4892-a570-125b7aedec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d42046c-6133-442a-9737-0e2f68e6d2a3', 'volume_size': 1, 'snapshot_id': '9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b950d6-0ab7-494f-a53e-9ca25f2f6c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Volume volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 (9d42046c-6133-442a-9737-0e2f68e6d2a3): created successfully Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b950d6-0ab7-494f-a53e-9ca25f2f6c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Flow 'volume_create_manager' (7e427ca2-625e-4c4b-b59b-6580b95ab928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c513a8cc-e674-4b6f-9096-73fcdfcb6af2 tempest-TestStampPattern-1922871812 None] Created volume successfully. Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Flow 'volume_create_manager' (f960baad-4587-4ef0-aec2-aafa4c680b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7574311e-571b-412a-8080-e2df64e01131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7574311e-571b-412a-8080-e2df64e01131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1168186443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fcb025-a009-4c8f-9cc7-34bec10b4358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88116ada6bc441d08752ef0eed46571b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:57Z,use_quota=True,user_id='72fc25085afa431c8deee8692c588b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4768af-595b-4399-acf6-37271e2af190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4768af-595b-4399-acf6-37271e2af190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68d3807-83da-4746-bd71-6e9f5a6d0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68d3807-83da-4746-bd71-6e9f5a6d0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11fcb025-a009-4c8f-9cc7-34bec10b4358', 'volume_name': 'volume-11fcb025-a009-4c8f-9cc7-34bec10b4358', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d48db5-4044-423a-8c49-bae3fbb322e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d48db5-4044-423a-8c49-bae3fbb322e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39d2cb0-a057-4d38-b40a-612909a7ab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume 11fcb025-a009-4c8f-9cc7-34bec10b4358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11fcb025-a009-4c8f-9cc7-34bec10b4358', 'volume_size': 1} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1168186443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fcb025-a009-4c8f-9cc7-34bec10b4358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88116ada6bc441d08752ef0eed46571b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:57Z,use_quota=True,user_id='72fc25085afa431c8deee8692c588b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Creating volume 11fcb025-a009-4c8f-9cc7-34bec10b4358 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:57 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:57 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 1073741824 Jul 07 22:50:57 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Flow 'volume_create_manager' (b6c9687c-7bdf-46ad-a692-013fd2d8ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603188e-f09d-490d-8533-0c47433616eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603188e-f09d-490d-8533-0c47433616eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1883325717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d133152-e37f-4eeb-bc06-b7fb44406114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88116ada6bc441d08752ef0eed46571b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:58Z,use_quota=True,user_id='72fc25085afa431c8deee8692c588b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df072b98-cab5-44d6-9c16-3a34ba1c1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df072b98-cab5-44d6-9c16-3a34ba1c1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ed449c-edc9-46c7-8117-49cc7bcd34a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ed449c-edc9-46c7-8117-49cc7bcd34a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d133152-e37f-4eeb-bc06-b7fb44406114', 'volume_name': 'volume-0d133152-e37f-4eeb-bc06-b7fb44406114', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ba660-785f-4b8c-949f-0fa45b05e716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ba660-785f-4b8c-949f-0fa45b05e716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2edcaf-03cd-4801-89f4-2d8de7a2c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume 0d133152-e37f-4eeb-bc06-b7fb44406114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d133152-e37f-4eeb-bc06-b7fb44406114', 'volume_size': 1} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:58 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 1073741824" returned: 0 in 1.458s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:58 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 Jul 07 22:50:58 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:59 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358" returned: 0 in 1.123s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] <== create_volume: return (2769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.776s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1883325717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d133152-e37f-4eeb-bc06-b7fb44406114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88116ada6bc441d08752ef0eed46571b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:58Z,use_quota=True,user_id='72fc25085afa431c8deee8692c588b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Creating volume 0d133152-e37f-4eeb-bc06-b7fb44406114 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:59 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:50:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:00 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 1073741824 Jul 07 22:51:00 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39d2cb0-a057-4d38-b40a-612909a7ab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11fcb025-a009-4c8f-9cc7-34bec10b4358', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c544ba-9144-47d5-8361-bea18311a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 (11fcb025-a009-4c8f-9cc7-34bec10b4358): created successfully Jul 07 22:51:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c544ba-9144-47d5-8361-bea18311a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Flow 'volume_create_manager' (f960baad-4587-4ef0-aec2-aafa4c680b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-844e76a0-cfb6-4057-8f7b-daac5a62cf53 tempest-TestServerVolumeAttachmentScenario-730146684 None] Created volume successfully. Jul 07 22:51:01 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 1073741824" returned: 0 in 1.163s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:01 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 Jul 07 22:51:01 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:02 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2edcaf-03cd-4801-89f4-2d8de7a2c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d133152-e37f-4eeb-bc06-b7fb44406114', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b144a-6bce-430b-abaf-e4a3b8049b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Volume volume-0d133152-e37f-4eeb-bc06-b7fb44406114 (0d133152-e37f-4eeb-bc06-b7fb44406114): created successfully Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b144a-6bce-430b-abaf-e4a3b8049b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Flow 'volume_create_manager' (b6c9687c-7bdf-46ad-a692-013fd2d8ce80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-393d1cca-a0b3-4dbe-9f64-b3a565d36191 tempest-TestServerVolumeAttachmentScenario-730146684 None] Created volume successfully. Jul 07 22:51:12 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=11,cinder:DELETE=1,cinder:SELECT=5,cinder:INSERT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:12 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:15 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:51:15 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:16 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.671s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:51:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:51:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:51:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bd6d8-af57-4271-b0b4-362192a6ce51]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:24 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 Jul 07 22:51:24 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:24 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3" returned: 0 in 0.808s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-9d42046c-6133-442a-9737-0e2f68e6d2a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a89545-e805-419f-a3d4-1c27be2440fc', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:51:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-649d76b2-1ad0-4818-a70d-618a4c967ef6 req-a0b08ffa-7e7b-482d-bccf-306646b30f93 tempest-TestStampPattern-1922871812 None] attachment_update completed successfully. Jul 07 22:51:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-92c58381-4e3b-4db8-a58f-3d826f68527e req-3d75cfe9-7f59-4152-a122-45dd0f3830f6 tempest-TestStampPattern-1922871812 None] Terminate volume connection completed successfully. Jul 07 22:51:31 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-92c58381-4e3b-4db8-a58f-3d826f68527e req-3d75cfe9-7f59-4152-a122-45dd0f3830f6 tempest-TestStampPattern-1922871812 None] Deleting attachment 49a89545-e805-419f-a3d4-1c27be2440fc. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:51:34 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-9d42046c-6133-442a-9737-0e2f68e6d2a3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "cinder-9d42046c-6133-442a-9737-0e2f68e6d2a3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e673e2-9f1d-466b-8d2f-182a6f8e7874]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:41 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 Jul 07 22:51:41 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:42 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3" returned: 0 in 0.776s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3 Jul 07 22:51:42 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ba610-31b8-463e-9a57-b899fcd83db7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:43 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9d42046c-6133-442a-9737-0e2f68e6d2a3" returned: 0 in 0.676s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9d42046c-6133-442a-9737-0e2f68e6d2a3" released by "delete_volume" :: held 1.496s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:43 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 Jul 07 22:51:43 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Created reservations ['dc75909d-bcde-4e65-8ff4-be0f01cbf268', '05d17b15-24be-4867-bafb-ed7b67c1a3d5', 'f1a1fc47-3fe2-40fa-89a5-a15aeee8f295', '48affa7b-a69b-45a5-a88b-3d954aa6b6c3'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:43 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:51:43 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:44 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358" returned: 0 in 0.819s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-11fcb025-a009-4c8f-9cc7-34bec10b4358', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d8cdb5f-665d-4aea-af1a-2fa9ab147fc8', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:51:44 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.689s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Deleted volume successfully. Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6d6b28b0-062a-463a-9afc-d088725c9b8d tempest-TestStampPattern-1922871812 None] Lock "cinder-9d42046c-6133-442a-9737-0e2f68e6d2a3-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-fa53e25a-5899-4723-847c-7b6dc72d88ea req-6b4b2685-8e9c-4e93-8352-0f8fc7dfbec6 tempest-TestServerVolumeAttachmentScenario-730146684 None] attachment_update completed successfully. Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Deleting offline snapshot 9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 of volume ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] snapshot_file for this snap is: volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d5862-8ff9-486b-814c-36fa654d3f77]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:44 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:51:44 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:45 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef272825-6acb-49d9-b1bd-b7719f6274d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:51:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30957d0-98cb-4a4f-8a3a-de684954184a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:45 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:51:45 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:46 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.783s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:46 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:51:46 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:46 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 0.745s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:46 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0 Jul 07 22:51:46 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:47 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3.9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" returned: 0 in 0.646s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0" released by "_delete_snapshot" :: held 3.084s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" released by "delete_snapshot" :: held 3.110s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Created reservations ['c546d543-6c5f-4d7d-a027-56200a6a7f06', '56253e74-1f04-4ae4-a823-c36650d85a67', '33eafd26-7ea6-40bd-ba11-406ce49ffada', '8b6d67da-69b6-4a83-8bf9-ebf34f6a7b19'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Delete snapshot completed successfully. Jul 07 22:51:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9e099987-5fb5-4b5d-9180-156054d838c3 tempest-TestStampPattern-1922871812 None] Lock "cinder-9e8a82a3-958a-4a1e-bcb4-4cc47c457ca0-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:54 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[86413b74-2511-4f30-a8c8-25df65daeb79]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 Jul 07 22:51:54 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:55 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114" returned: 0 in 0.779s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c', 'name': 'volume-0d133152-e37f-4eeb-bc06-b7fb44406114', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64dfcad6-e179-41b6-bec5-ecd28f0fa9f9', 'enforce_multipath': True} {{(pid=88087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:51:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-b02a55b9-9f08-425c-9cc3-980094e77db9 req-97cddd56-20b9-41db-a5e1-d9d5e378ac5d tempest-TestServerVolumeAttachmentScenario-730146684 None] attachment_update completed successfully. Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-ef272825-6acb-49d9-b1bd-b7719f6274d3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "cinder-ef272825-6acb-49d9-b1bd-b7719f6274d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Acquiring lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152a97f-d8fe-45fd-b5c7-330011b2a079]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:56 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:51:56 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:57 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.793s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:57 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3 Jul 07 22:51:57 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:58 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ef272825-6acb-49d9-b1bd-b7719f6274d3" returned: 0 in 0.682s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "cinder-quobyte-ef272825-6acb-49d9-b1bd-b7719f6274d3" released by "delete_volume" :: held 1.535s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Created reservations ['e66d0738-4272-47ae-a031-e37a231b36f6', 'f49056c2-476d-4f14-bb88-82f028e8acbb', 'b9879494-61af-47ef-a9d9-0746f4e5b5da', '796a696e-6c4c-4e51-8b81-1308cedde3b5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:58 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:51:58 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:59 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.655s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Deleted volume successfully. Jul 07 22:51:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-68a98172-441a-436a-854a-4d75000386a8 tempest-TestStampPattern-1922871812 None] Lock "cinder-ef272825-6acb-49d9-b1bd-b7719f6274d3-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:01 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-5fb45c33-adbf-4fd8-a4f0-5299b36d8462 req-eac6c83c-9847-4dbf-b476-56ec42618f4a tempest-TestServerVolumeAttachmentScenario-730146684 None] Terminate volume connection completed successfully. Jul 07 22:52:01 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-5fb45c33-adbf-4fd8-a4f0-5299b36d8462 req-eac6c83c-9847-4dbf-b476-56ec42618f4a tempest-TestServerVolumeAttachmentScenario-730146684 None] Deleting attachment 64dfcad6-e179-41b6-bec5-ecd28f0fa9f9. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:52:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [req-7b892b27-f449-490a-97f3-dac4952d040a req-724ca720-7080-4f35-b6ab-70d21751573b tempest-TestServerVolumeAttachmentScenario-730146684 None] Terminate volume connection completed successfully. Jul 07 22:52:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [req-7b892b27-f449-490a-97f3-dac4952d040a req-724ca720-7080-4f35-b6ab-70d21751573b tempest-TestServerVolumeAttachmentScenario-730146684 None] Deleting attachment 7d8cdb5f-665d-4aea-af1a-2fa9ab147fc8. {{(pid=88087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Flow 'volume_create_manager' (4b65e474-5210-4d12-af73-32cffc9a0032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca4ebe-511d-431b-bc51-0a2b72204481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca4ebe-511d-431b-bc51-0a2b72204481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab1941a-7cdf-4fd8-8802-225fdbfafc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da07d9cdd6a46608afd24307d01f6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:13Z,use_quota=True,user_id='703e740c2d6e48a2a84e391a0fb89108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a54ec73-d2d8-4629-b5a8-a155c9cbdfc9),volume_type_id=6a54ec73-d2d8-4629-b5a8-a155c9cbdfc9)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8b61bd-a221-4634-9b0d-7ceeeffba0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8b61bd-a221-4634-9b0d-7ceeeffba0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29409754-cfd7-4852-98ec-30d2d094bc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29409754-cfd7-4852-98ec-30d2d094bc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dab1941a-7cdf-4fd8-8802-225fdbfafc56', 'volume_name': 'volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56', 'volume_size': 1, 'image_id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9f3f96800c4df0a4473adcdb505d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7da07d9cdd6a46608afd24307d01f6b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30316905c1cdc5015d47772d214da2c576a76b4e7c294751da8fc044ecf7475103fcf96c2e01090f8d99b0af7e06a705bc8e96ed407b62e67cac9bb57469b867', 'id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d53dd65-e26b-4902-bf4b-206199f72763/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1840852f-d857-4ef3-8022-e55fb445d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1840852f-d857-4ef3-8022-e55fb445d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec21b2bc-6f7c-4a0e-aa53-dd7859ae9300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:13 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Volume dab1941a-7cdf-4fd8-8802-225fdbfafc56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56', 'volume_size': 1, 'image_id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9f3f96800c4df0a4473adcdb505d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7da07d9cdd6a46608afd24307d01f6b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30316905c1cdc5015d47772d214da2c576a76b4e7c294751da8fc044ecf7475103fcf96c2e01090f8d99b0af7e06a705bc8e96ed407b62e67cac9bb57469b867', 'id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d53dd65-e26b-4902-bf4b-206199f72763/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Trying to clone dab1941a-7cdf-4fd8-8802-225fdbfafc56 from image 1d53dd65-e26b-4902-bf4b-206199f72763 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:52:13 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:52:13 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:52:14 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952b2a2-eb4e-4307-86eb-1c51a5edf336]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:14 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:14 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:14 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "cinder-0d133152-e37f-4eeb-bc06-b7fb44406114-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-0d133152-e37f-4eeb-bc06-b7fb44406114-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "cinder-quobyte-0d133152-e37f-4eeb-bc06-b7fb44406114" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-quobyte-0d133152-e37f-4eeb-bc06-b7fb44406114" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc551c0d-473b-4a01-af12-5a35665fdcc6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:15 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 Jul 07 22:52:15 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:15 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:15 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:15 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 1 in 0.782s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Temporary image 1d53dd65-e26b-4902-bf4b-206199f72763 is fetched for user 703e740c2d6e48a2a84e391a0fb89108. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa4119-d4e8-40cf-b682-22abc1f95a59]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:15 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:15 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:16 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:16 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114 Jul 07 22:52:16 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:16 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:52:16 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:16 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:16 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:16 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0d133152-e37f-4eeb-bc06-b7fb44406114" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-quobyte-0d133152-e37f-4eeb-bc06-b7fb44406114" released by "delete_volume" :: held 1.600s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Created reservations ['7391ba7a-8db9-48be-a0e3-b6292cffac44', '27d9089c-8d16-4dbc-8e1c-db24f62b9f5a', '0e21766c-7b20-4f8e-9f5e-8fb2a3ea79fb', '4efe4b17-3547-4715-b3cb-dcfdabab8bd6'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:17 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:17 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:17 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab1941a-7cdf-4fd8-8802-225fdbfafc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da07d9cdd6a46608afd24307d01f6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:13Z,use_quota=True,user_id='703e740c2d6e48a2a84e391a0fb89108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a54ec73-d2d8-4629-b5a8-a155c9cbdfc9),volume_type_id=6a54ec73-d2d8-4629-b5a8-a155c9cbdfc9)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Creating volume dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:17 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:17 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1073741824 Jul 07 22:52:17 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "cinder-11fcb025-a009-4c8f-9cc7-34bec10b4358-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-11fcb025-a009-4c8f-9cc7-34bec10b4358-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "cinder-quobyte-11fcb025-a009-4c8f-9cc7-34bec10b4358" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-quobyte-11fcb025-a009-4c8f-9cc7-34bec10b4358" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb17081-786b-4d3e-b27a-fbddc595540a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:17 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.705s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Deleted volume successfully. Jul 07 22:52:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-13fe524c-c1a3-4c84-a939-611e86b4e016 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-0d133152-e37f-4eeb-bc06-b7fb44406114-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:17 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 Jul 07 22:52:17 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:18 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1073741824" returned: 0 in 1.077s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:18 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:18 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:18 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358" returned: 0 in 0.884s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:18 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358 Jul 07 22:52:18 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:19 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 0 in 0.739s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Attempting download of 1d53dd65-e26b-4902-bf4b-206199f72763 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}])) to volume dab1941a-7cdf-4fd8-8802-225fdbfafc56. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39f2ee-8119-4723-a3c4-93acbc699c33]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:19 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr Jul 07 22:52:19 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:19 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-11fcb025-a009-4c8f-9cc7-34bec10b4358" returned: 0 in 0.805s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-quobyte-11fcb025-a009-4c8f-9cc7-34bec10b4358" released by "delete_volume" :: held 1.759s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Created reservations ['4c12be73-9f71-4984-a610-67c88d70df70', 'cadabaf6-4487-494d-9439-fbbf3455bb86', 'fa9c4fbc-80bd-4ead-ad4d-6943537fb8da', '9ecad845-bf40-4023-b0a0-7c0b876f6691'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:19 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:19 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:20 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr" returned: 0 in 0.920s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:20 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.666s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:20 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:20 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Deleted volume successfully. Jul 07 22:52:20 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e6d8f3ed-fd9f-430d-817b-08948986e9b0 tempest-TestServerVolumeAttachmentScenario-730146684 None] Lock "cinder-11fcb025-a009-4c8f-9cc7-34bec10b4358-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:20 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr Jul 07 22:52:20 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:21 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr" returned: 1 in 0.986s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d53dd65-e26b-4902-bf4b-206199f72763_i719ferr' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93846713-2be0-4cd6-a6e3-2b58c474474a]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:21 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:21 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:22 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 0 in 1.011s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:22 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD Jul 07 22:52:22 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:23 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD" returned: 1 in 1.108s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:23 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] 1d53dd65-e26b-4902-bf4b-206199f72763 was raw, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:52:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:23 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:23 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:24 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:24 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1d53dd65-e26b-4902-bf4b-206199f72763_1fby_8ardevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:52:24 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:52:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:24 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1G Jul 07 22:52:24 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:25 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 1G" returned: 0 in 0.866s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6797f410-a1f0-47fc-938d-621dcf5c2eb6]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:25 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:25 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:25 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 0 in 0.876s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:26 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:26 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:26 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 1 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Downloaded image 1d53dd65-e26b-4902-bf4b-206199f72763 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}])) to volume dab1941a-7cdf-4fd8-8802-225fdbfafc56 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Temporary image 1d53dd65-e26b-4902-bf4b-206199f72763 for user 703e740c2d6e48a2a84e391a0fb89108 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Marking volume dab1941a-7cdf-4fd8-8802-225fdbfafc56 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Copying metadata from image 1d53dd65-e26b-4902-bf4b-206199f72763 to dab1941a-7cdf-4fd8-8802-225fdbfafc56. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Creating volume glance metadata for volume dab1941a-7cdf-4fd8-8802-225fdbfafc56 backed by image 1d53dd65-e26b-4902-bf4b-206199f72763 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '79f9f3f96800c4df0a4473adcdb505d2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec21b2bc-6f7c-4a0e-aa53-dd7859ae9300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56', 'volume_size': 1, 'image_id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d53dd65-e26b-4902-bf4b-206199f72763', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9f3f96800c4df0a4473adcdb505d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7da07d9cdd6a46608afd24307d01f6b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30316905c1cdc5015d47772d214da2c576a76b4e7c294751da8fc044ecf7475103fcf96c2e01090f8d99b0af7e06a705bc8e96ed407b62e67cac9bb57469b867', 'id': '1d53dd65-e26b-4902-bf4b-206199f72763', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d53dd65-e26b-4902-bf4b-206199f72763/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02c433-77f1-4892-9cbd-b4ad6239cde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:26 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Volume volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 (dab1941a-7cdf-4fd8-8802-225fdbfafc56): created successfully Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02c433-77f1-4892-9cbd-b4ad6239cde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Flow 'volume_create_manager' (4b65e474-5210-4d12-af73-32cffc9a0032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-841005b4-34eb-499d-9cbc-12527e9525a8 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Created volume successfully. Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Acquiring lock "cinder-dab1941a-7cdf-4fd8-8802-225fdbfafc56-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "cinder-dab1941a-7cdf-4fd8-8802-225fdbfafc56-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Acquiring lock "cinder-quobyte-dab1941a-7cdf-4fd8-8802-225fdbfafc56" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "cinder-quobyte-dab1941a-7cdf-4fd8-8802-225fdbfafc56" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44425a1-b7a4-4b28-b50d-af60c5bfc9a4]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:27 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:27 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:28 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 0 in 0.919s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:28 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:28 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:29 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 1 in 0.958s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:52:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:29 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56 Jul 07 22:52:29 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:30 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-dab1941a-7cdf-4fd8-8802-225fdbfafc56" returned: 0 in 0.661s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "cinder-quobyte-dab1941a-7cdf-4fd8-8802-225fdbfafc56" released by "delete_volume" :: held 2.610s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:30 devstack cinder-volume[88087]: WARNING cinder.quota [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:52:30 devstack cinder-volume[88087]: WARNING cinder.quota [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Created reservations ['513206f1-bbf4-445a-ac70-f86f3f5232b5', 'f5cead54-ac38-4023-b79a-704c7809caee', 'c27b3531-d6d4-4a32-8d47-5c0cab316771', 'e66d7ba9-8729-40ca-a495-6792d0b00492'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:30 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:30 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:31 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.671s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:31 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Deleted volume successfully. Jul 07 22:52:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8abae2d6-8336-47cf-bb11-1155f76b66a2 tempest-VolumeAndVolumeTypeFromImageTest-997382255 None] Lock "cinder-dab1941a-7cdf-4fd8-8802-225fdbfafc56-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (61bdc91a-b6b3-4869-9551-e12c2c5e6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fffc9da-1bc7-415f-b07b-f2969f266a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fffc9da-1bc7-415f-b07b-f2969f266a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-805634882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bba2a85-adc5-4bb5-aa2e-c7d857c98914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:32Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb319a8-5126-472c-955e-522d85786168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb319a8-5126-472c-955e-522d85786168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db38b8aa-2c98-4655-adb6-35b32d8c1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db38b8aa-2c98-4655-adb6-35b32d8c1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bba2a85-adc5-4bb5-aa2e-c7d857c98914', 'volume_name': 'volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d16cb18-f046-4557-8b8a-dd9ac4c42a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d16cb18-f046-4557-8b8a-dd9ac4c42a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ddcff0-8364-4ceb-a789-045712e4ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume 5bba2a85-adc5-4bb5-aa2e-c7d857c98914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914', 'volume_size': 1} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-805634882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bba2a85-adc5-4bb5-aa2e-c7d857c98914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:32Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume 5bba2a85-adc5-4bb5-aa2e-c7d857c98914 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:32 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:32 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 1073741824 Jul 07 22:52:32 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:33 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 1073741824" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:33 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 Jul 07 22:52:33 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:34 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" returned: 0 in 0.658s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ddcff0-8364-4ceb-a789-045712e4ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148e9d7b-2922-4517-9b24-23dd1c32c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 (5bba2a85-adc5-4bb5-aa2e-c7d857c98914): created successfully Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148e9d7b-2922-4517-9b24-23dd1c32c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (61bdc91a-b6b3-4869-9551-e12c2c5e6484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f15b0460-86ab-442f-810e-4f090e5c32e3 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (ec2d96a3-46de-4da6-8878-9c9a43408c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0079263-e4fe-4cdb-a7eb-6c265668719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0079263-e4fe-4cdb-a7eb-6c265668719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346151607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284b3fc3-a70b-45ba-ae84-ea3480504991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:35Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf96c0d8-e83c-41e2-b69d-a173c51a228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf96c0d8-e83c-41e2-b69d-a173c51a228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16151c3-941e-4ef8-8101-b1ac3463c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16151c3-941e-4ef8-8101-b1ac3463c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284b3fc3-a70b-45ba-ae84-ea3480504991', 'volume_name': 'volume-284b3fc3-a70b-45ba-ae84-ea3480504991', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ef2d7d-e509-4bab-aebc-548110cba690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ef2d7d-e509-4bab-aebc-548110cba690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83abbd87-e0cc-42ae-9074-d8a2607fadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume 284b3fc3-a70b-45ba-ae84-ea3480504991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284b3fc3-a70b-45ba-ae84-ea3480504991', 'volume_size': 1} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346151607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284b3fc3-a70b-45ba-ae84-ea3480504991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:35Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume 284b3fc3-a70b-45ba-ae84-ea3480504991 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:35 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:35 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 1073741824 Jul 07 22:52:35 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=59,cinder:SELECT=56,cinder:INSERT=20,cinder:DELETE=5 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (5e4f6547-fc01-491b-a41d-ebe3cb8c83b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8fb15-69ec-4837-9edf-394844c868ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8fb15-69ec-4837-9edf-394844c868ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692147347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9f293d-f2e4-453f-8927-d3ef9c553fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:35Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223b818d-7b5a-4b0d-b36d-b94e145c29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223b818d-7b5a-4b0d-b36d-b94e145c29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0aeba9-10a1-430a-8ad8-807cb07ff38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0aeba9-10a1-430a-8ad8-807cb07ff38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae9f293d-f2e4-453f-8927-d3ef9c553fe6', 'volume_name': 'volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4a6724-067f-4da8-a36e-90f1ef2eb622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4a6724-067f-4da8-a36e-90f1ef2eb622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafb40ae-0ce3-4b58-b87a-17aa269ee9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume ae9f293d-f2e4-453f-8927-d3ef9c553fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6', 'volume_size': 1} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (80f7084b-f57e-4b3a-9cc3-5de12c70ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d058b9c1-6b90-4493-ab2e-fc15f0bd6be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d058b9c1-6b90-4493-ab2e-fc15f0bd6be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896564045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b978092-ceb0-4837-ba2b-4a9d60b417cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:36Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e89a0-cfe1-4318-b7f3-ead14161ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e89a0-cfe1-4318-b7f3-ead14161ac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0856e801-e9a4-4d96-ab0e-3a5cb486a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0856e801-e9a4-4d96-ab0e-3a5cb486a811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b978092-ceb0-4837-ba2b-4a9d60b417cb', 'volume_name': 'volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc885be8-8ff8-436d-8962-a5f7c5915017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc885be8-8ff8-436d-8962-a5f7c5915017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5551b2e-03bd-4d8c-bed3-181d75885dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume 1b978092-ceb0-4837-ba2b-4a9d60b417cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb', 'volume_size': 1} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:36 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 1073741824" returned: 0 in 1.141s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:36 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 Jul 07 22:52:36 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (28b598a2-aaee-4b6b-a9d6-ed99b445c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50722a87-cc7a-4857-bc9a-b050a71810dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50722a87-cc7a-4857-bc9a-b050a71810dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11041691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea863b1-dca0-4513-8aba-7091c28e1fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:36Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7ab7e6-fe96-4b3c-b21f-26637aac043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7ab7e6-fe96-4b3c-b21f-26637aac043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d72cabf-d20f-4d6d-a2f4-c68ce0ba0d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d72cabf-d20f-4d6d-a2f4-c68ce0ba0d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea863b1-dca0-4513-8aba-7091c28e1fde', 'volume_name': 'volume-8ea863b1-dca0-4513-8aba-7091c28e1fde', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b27632-cf68-4260-a007-8fa94029e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b27632-cf68-4260-a007-8fa94029e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723a7009-0208-430e-b773-616983edc4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume 8ea863b1-dca0-4513-8aba-7091c28e1fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea863b1-dca0-4513-8aba-7091c28e1fde', 'volume_size': 1} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Flow 'volume_create_manager' (9823b0e9-66a9-40a0-b325-27054802b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f00b9c-808d-4a22-aadd-1e3dfcb94d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f00b9c-808d-4a22-aadd-1e3dfcb94d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224308907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000442ef-9db5-4a25-acb2-78ff47f366f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dafc87ac11c48079a91b59a589c4085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='f6c32f8a24fa409ba39e3fadf6501e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72867aae-4092-4953-97cd-48b425b6c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72867aae-4092-4953-97cd-48b425b6c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b50bc7c-1131-4a89-898a-5d5d62a6167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b50bc7c-1131-4a89-898a-5d5d62a6167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000442ef-9db5-4a25-acb2-78ff47f366f1', 'volume_name': 'volume-000442ef-9db5-4a25-acb2-78ff47f366f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7c14b-d18b-4b92-a5f2-dacbb5320716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7c14b-d18b-4b92-a5f2-dacbb5320716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28688ab0-569d-4ca5-b276-0f7d24a0a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Volume 000442ef-9db5-4a25-acb2-78ff47f366f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000442ef-9db5-4a25-acb2-78ff47f366f1', 'volume_size': 1} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (e8f8a728-bbab-47ba-9fe0-08602fc94bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4921a2f-c1f7-4331-9d70-4a214e105dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4921a2f-c1f7-4331-9d70-4a214e105dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924640992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339dec8c-2180-4faa-9a6d-271ab3fc93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7e0612-9b34-43fa-ae77-81532653a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7e0612-9b34-43fa-ae77-81532653a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f484c3-1c2e-4f1a-a681-ca33d68fc7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f484c3-1c2e-4f1a-a681-ca33d68fc7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339dec8c-2180-4faa-9a6d-271ab3fc93ac', 'volume_name': 'volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff7c958-c375-4e68-b753-70404c138c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff7c958-c375-4e68-b753-70404c138c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5325499-d3db-4b16-a6c5-47c7f0350c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume 339dec8c-2180-4faa-9a6d-271ab3fc93ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac', 'volume_size': 1} Jul 07 22:52:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:37 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991" returned: 0 in 0.857s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692147347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9f293d-f2e4-453f-8927-d3ef9c553fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:35Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume ae9f293d-f2e4-453f-8927-d3ef9c553fe6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:37 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83abbd87-e0cc-42ae-9074-d8a2607fadde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284b3fc3-a70b-45ba-ae84-ea3480504991', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 1073741824 Jul 07 22:52:37 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d97f8-f9df-4d73-95f6-65ea1fd6ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-284b3fc3-a70b-45ba-ae84-ea3480504991 (284b3fc3-a70b-45ba-ae84-ea3480504991): created successfully Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d97f8-f9df-4d73-95f6-65ea1fd6ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (ec2d96a3-46de-4da6-8878-9c9a43408c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cd7346e2-e1d2-4cda-850d-598f342a0e57 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:38 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 1073741824" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:38 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 Jul 07 22:52:38 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:38 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" returned: 0 in 0.644s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.693s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896564045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b978092-ceb0-4837-ba2b-4a9d60b417cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:36Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume 1b978092-ceb0-4837-ba2b-4a9d60b417cb {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:38 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafb40ae-0ce3-4b58-b87a-17aa269ee9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:38 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb 1073741824 Jul 07 22:52:38 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d14529b-e9ad-4313-a9fc-17a142fc253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:38 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 (ae9f293d-f2e4-453f-8927-d3ef9c553fe6): created successfully Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d14529b-e9ad-4313-a9fc-17a142fc253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:38 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (5e4f6547-fc01-491b-a41d-ebe3cb8c83b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:38 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-88dd76bd-d527-4b88-8eb7-a2855e662c9f tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:39 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb 1073741824" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:39 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb Jul 07 22:52:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:40 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb" returned: 0 in 0.661s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.630s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11041691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea863b1-dca0-4513-8aba-7091c28e1fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:36Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume 8ea863b1-dca0-4513-8aba-7091c28e1fde {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:40 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5551b2e-03bd-4d8c-bed3-181d75885dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:40 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde 1073741824 Jul 07 22:52:40 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ebde5c-a7fe-4367-9c33-1a0bd04bfb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:40 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb (1b978092-ceb0-4837-ba2b-4a9d60b417cb): created successfully Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ebde5c-a7fe-4367-9c33-1a0bd04bfb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (80f7084b-f57e-4b3a-9cc3-5de12c70ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-afb5879f-304c-4024-b037-4a2203d532e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:41 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde 1073741824" returned: 0 in 0.799s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:41 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde Jul 07 22:52:41 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:41 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde" returned: 0 in 0.622s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.992s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224308907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000442ef-9db5-4a25-acb2-78ff47f366f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dafc87ac11c48079a91b59a589c4085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='f6c32f8a24fa409ba39e3fadf6501e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Creating volume 000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:41 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 1073741824 Jul 07 22:52:41 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723a7009-0208-430e-b773-616983edc4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea863b1-dca0-4513-8aba-7091c28e1fde', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8dfe5-637e-455b-9074-d4054bf75965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=65,cinder:DELETE=3 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:52:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-8ea863b1-dca0-4513-8aba-7091c28e1fde (8ea863b1-dca0-4513-8aba-7091c28e1fde): created successfully Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8dfe5-637e-455b-9074-d4054bf75965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (28b598a2-aaee-4b6b-a9d6-ed99b445c90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d7dd6384-84a6-4970-a35c-1f13f0adf645 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:42 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 1073741824" returned: 0 in 0.882s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:42 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:52:42 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.683s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.325s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924640992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339dec8c-2180-4faa-9a6d-271ab3fc93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347acc8bca7a4f0a8cb98e0d59ca70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='331646acb5764f24abfa66ed995e9707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Creating volume 339dec8c-2180-4faa-9a6d-271ab3fc93ac {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:43 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28688ab0-569d-4ca5-b276-0f7d24a0a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000442ef-9db5-4a25-acb2-78ff47f366f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf5e3be-cf50-47b0-85b4-20ebcb86e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:43 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac 1073741824 Jul 07 22:52:43 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Volume volume-000442ef-9db5-4a25-acb2-78ff47f366f1 (000442ef-9db5-4a25-acb2-78ff47f366f1): created successfully Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf5e3be-cf50-47b0-85b4-20ebcb86e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Flow 'volume_create_manager' (9823b0e9-66a9-40a0-b325-27054802b149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-86e51bb7-e709-49a1-8512-36c644224724 tempest-VolumeDependencyTests-1840366374 None] Created volume successfully. Jul 07 22:52:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:44 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac 1073741824" returned: 0 in 0.949s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:44 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac Jul 07 22:52:44 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:44 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac" returned: 0 in 0.695s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.923s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Creating offline snapshot a5a47db4-8bf1-4997-9348-244d32daa487 of volume 000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[257e3245-124d-41b8-9e62-6e2eec9be936]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5325499-d3db-4b16-a6c5-47c7f0350c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a483c136-0794-4734-a115-ea44a1323a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Volume volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac (339dec8c-2180-4faa-9a6d-271ab3fc93ac): created successfully Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a483c136-0794-4734-a115-ea44a1323a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Flow 'volume_create_manager' (e8f8a728-bbab-47ba-9fe0-08602fc94bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e58a4776-45cd-43f8-89b9-1762633f9079 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created volume successfully. Jul 07 22:52:45 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:52:45 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-339dec8c-2180-4faa-9a6d-271ab3fc93ac-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-339dec8c-2180-4faa-9a6d-271ab3fc93ac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-339dec8c-2180-4faa-9a6d-271ab3fc93ac" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-339dec8c-2180-4faa-9a6d-271ab3fc93ac" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbee5654-9a27-4655-b716-88c3a907e4cf]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:45 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac Jul 07 22:52:45 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:45 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:45 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 1G Jul 07 22:52:45 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:46 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:46 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac Jul 07 22:52:46 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:46 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 1G" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000442ef-9db5-4a25-acb2-78ff47f366f1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:46 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000442ef-9db5-4a25-acb2-78ff47f366f1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:52:46 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:46 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-339dec8c-2180-4faa-9a6d-271ab3fc93ac" returned: 0 in 0.683s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-339dec8c-2180-4faa-9a6d-271ab3fc93ac" released by "delete_volume" :: held 1.477s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['27124800-ee87-4924-8469-094ad1398e7c', '1032b333-1095-4299-bbe8-0fb5bbf7fd16', '12b45a63-9e4c-4b01-a977-08383b447f1b', '4eae8969-19e0-4c27-8ad1-574811623362'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:47 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:47 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000442ef-9db5-4a25-acb2-78ff47f366f1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.728s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:47 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 is being set with open permissions: ugo+rw Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:47 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:52:47 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-8ea863b1-dca0-4513-8aba-7091c28e1fde-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-8ea863b1-dca0-4513-8aba-7091c28e1fde-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-8ea863b1-dca0-4513-8aba-7091c28e1fde" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-8ea863b1-dca0-4513-8aba-7091c28e1fde" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbee9e2-9161-41e4-94a3-9f1da20cf8be]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:47 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde Jul 07 22:52:47 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.796s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:52:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e1593af3-174f-4178-8ea8-3a6541cb2f29 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-339dec8c-2180-4faa-9a6d-271ab3fc93ac-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:48 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.693s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:48 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info Jul 07 22:52:48 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:48 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde" returned: 0 in 0.796s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:48 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde Jul 07 22:52:48 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:48 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info" returned: 0 in 0.750s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:48 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info is being set with open permissions: ugo+rw Jul 07 22:52:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:48 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info Jul 07 22:52:48 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:49 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8ea863b1-dca0-4513-8aba-7091c28e1fde" returned: 0 in 0.798s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-8ea863b1-dca0-4513-8aba-7091c28e1fde" released by "delete_volume" :: held 1.639s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['d45d85e6-6c25-47b1-a82c-7f9b5c140c01', '32163017-3dc8-4418-a372-92ed96217ae5', '1405b7ad-9d86-45ed-9f0a-236421364241', '16f69e45-84c8-4e45-9877-c7ff77a02fda'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:49 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:49 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:49 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.info" returned: 0 in 0.682s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.608s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e495f8a5-33a0-4caa-973d-bf77fd6de62c tempest-VolumeDependencyTests-1840366374 None] Create snapshot completed successfully Jul 07 22:52:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-1b978092-ceb0-4837-ba2b-4a9d60b417cb-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-1b978092-ceb0-4837-ba2b-4a9d60b417cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-1b978092-ceb0-4837-ba2b-4a9d60b417cb" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-1b978092-ceb0-4837-ba2b-4a9d60b417cb" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[83842d18-4f4a-4dfa-986f-ca2605d2900b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:50 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.664s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:52:50 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb Jul 07 22:52:50 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1171472c-9f01-4f55-9a60-7f0394a1a19a tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-8ea863b1-dca0-4513-8aba-7091c28e1fde-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:50 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb" returned: 0 in 0.833s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:50 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb Jul 07 22:52:50 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Flow 'volume_create_manager' (b7cdad78-fc73-402f-aa2f-d94906573c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364402f3-a17b-4aab-bd42-0fce03838fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364402f3-a17b-4aab-bd42-0fce03838fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2018675737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0e692f-a690-4943-9941-f207cb0639e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dafc87ac11c48079a91b59a589c4085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5a47db4-8bf1-4997-9348-244d32daa487,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:51Z,use_quota=True,user_id='f6c32f8a24fa409ba39e3fadf6501e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e22740-265a-4c13-a868-20d99659967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e22740-265a-4c13-a868-20d99659967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134ac88d-2976-4bad-a812-e926dd6442de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134ac88d-2976-4bad-a812-e926dd6442de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb0e692f-a690-4943-9941-f207cb0639e3', 'volume_name': 'volume-cb0e692f-a690-4943-9941-f207cb0639e3', 'volume_size': 1, 'snapshot_id': 'a5a47db4-8bf1-4997-9348-244d32daa487'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f522fce8-1c0d-49a8-bb09-ce3c0ff5e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f522fce8-1c0d-49a8-bb09-ce3c0ff5e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c4d418-72ca-48b6-af7d-a9fd11ab4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Volume cb0e692f-a690-4943-9941-f207cb0639e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb0e692f-a690-4943-9941-f207cb0639e3', 'volume_size': 1, 'snapshot_id': 'a5a47db4-8bf1-4997-9348-244d32daa487'} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487-cb0e692f-a690-4943-9941-f207cb0639e3" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487-cb0e692f-a690-4943-9941-f207cb0639e3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Creating volume cb0e692f-a690-4943-9941-f207cb0639e3 from snapshot a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] snapshot: a5a47db4-8bf1-4997-9348-244d32daa487, volume: cb0e692f-a690-4943-9941-f207cb0639e3, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9372c3-4b10-48ea-94d0-68f11e90af62]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:51 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:52:51 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:51 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-1b978092-ceb0-4837-ba2b-4a9d60b417cb" returned: 0 in 0.696s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-1b978092-ceb0-4837-ba2b-4a9d60b417cb" released by "delete_volume" :: held 1.570s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['ac56d41d-6932-4026-ab67-ade551c42344', 'b30e4c7f-e471-48d2-88a0-a163eeca131e', '802dbf87-8e74-4b41-ba27-87ce663fc1ae', '5d4a5f20-6eec-40bf-b8d3-1505d38e53ea'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:51 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:51 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:52 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.801s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000442ef-9db5-4a25-acb2-78ff47f366f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e7dfc-6251-462a-a4d3-f49bbae523fc]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:52 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:52:52 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:52 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.692s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-ae9f293d-f2e4-453f-8927-d3ef9c553fe6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-20b14c9a-35d8-44e0-9625-ef2000832dc4 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-1b978092-ceb0-4837-ba2b-4a9d60b417cb-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-ae9f293d-f2e4-453f-8927-d3ef9c553fe6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" acquired by "delete_volume" :: waited 0.013s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf5812-5a2f-4713-ae45-fb070d5496ab]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:52 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 Jul 07 22:52:52 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:52 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:52:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:52 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 Jul 07 22:52:53 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:53 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" returned: 0 in 0.812s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:53 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6 Jul 07 22:52:53 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:54 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" returned: 0 in 1.016s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-ae9f293d-f2e4-453f-8927-d3ef9c553fe6" released by "delete_volume" :: held 1.893s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['4d73691e-a603-4d52-9918-93891be78b08', '7eb0b53a-9f42-438c-8149-674ade60b840', 'c0390660-12a4-4bb0-989c-8e76bc164b77', 'e3b11906-a08f-49fd-bc24-a271a34a4c27'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:54 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:54 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-284b3fc3-a70b-45ba-ae84-ea3480504991-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-284b3fc3-a70b-45ba-ae84-ea3480504991-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-284b3fc3-a70b-45ba-ae84-ea3480504991" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-284b3fc3-a70b-45ba-ae84-ea3480504991" acquired by "delete_volume" :: waited 0.043s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c474242b-f8a1-44c8-8df1-6488c4fb751f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:55 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 Jul 07 22:52:55 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:57 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 2.246s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:57 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:52:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d98fea89-9588-438d-868c-3a64c9561872 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-ae9f293d-f2e4-453f-8927-d3ef9c553fe6-delete_volume" released by "delete_volume" :: held 4.542s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:57 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991" returned: 0 in 1.860s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:57 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991 Jul 07 22:52:57 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:58 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3" returned: 0 in 5.694s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ffde9-7b9f-4a0f-9ed1-5209f6791d2a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:58 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-284b3fc3-a70b-45ba-ae84-ea3480504991" returned: 0 in 1.580s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-284b3fc3-a70b-45ba-ae84-ea3480504991" released by "delete_volume" :: held 3.548s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['38ac0b25-cd2f-4af5-b0fb-74941aefa224', '4f0bf933-c0fa-4bcd-b18c-c76a59f2ba00', 'efe8c9ce-5d23-4dad-965d-1db4878250c6', '94397c6a-86a5-406c-9aeb-247f5f87719e'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:58 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:52:58 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:58 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:52:58 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:59 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.662s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-23b5e204-f5ac-4cd0-890e-a1fe4ce13453 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-284b3fc3-a70b-45ba-ae84-ea3480504991-delete_volume" released by "delete_volume" :: held 4.516s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:59 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.984s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:52:59 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Converted 1024.00 MB image at 179.81 MB/s Jul 07 22:52:59 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 is being set with open permissions: ugo+rw Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:59 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 Jul 07 22:52:59 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-5bba2a85-adc5-4bb5-aa2e-c7d857c98914-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-5bba2a85-adc5-4bb5-aa2e-c7d857c98914-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "cinder-quobyte-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1305b2-05aa-4ee2-97be-07afca389b6d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:00 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 Jul 07 22:53:00 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:00 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3" returned: 0 in 0.660s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" released by "_copy_volume_from_snapshot" :: held 9.081s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487-cb0e692f-a690-4943-9941-f207cb0639e3" released by "_create_volume_from_snapshot" :: held 9.126s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.145s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c4d418-72ca-48b6-af7d-a9fd11ab4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0e692f-a690-4943-9941-f207cb0639e3', 'volume_size': 1, 'snapshot_id': 'a5a47db4-8bf1-4997-9348-244d32daa487'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b53635-994f-445e-a84a-b9fd2152d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Volume volume-cb0e692f-a690-4943-9941-f207cb0639e3 (cb0e692f-a690-4943-9941-f207cb0639e3): created successfully Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b53635-994f-445e-a84a-b9fd2152d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Flow 'volume_create_manager' (b7cdad78-fc73-402f-aa2f-d94906573c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:00 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e2823dbc-c437-4bbf-9efc-ab44e2c80457 tempest-VolumeDependencyTests-1840366374 None] Created volume successfully. Jul 07 22:53:00 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" returned: 0 in 0.775s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:00 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914 Jul 07 22:53:00 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-a5a47db4-8bf1-4997-9348-244d32daa487-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-a5a47db4-8bf1-4997-9348-244d32daa487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Deleting offline snapshot a5a47db4-8bf1-4997-9348-244d32daa487 of volume 000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] snapshot_file for this snap is: volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fb778f-6c72-4361-8441-2f1f41b3b51b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:01 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:53:01 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:01 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" returned: 0 in 0.655s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-quobyte-5bba2a85-adc5-4bb5-aa2e-c7d857c98914" released by "delete_volume" :: held 1.487s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Created reservations ['e51662e2-cbb5-4f14-81ce-eded979edfa1', 'ec1bc5ac-98bb-4cee-aa9a-284340017795', 'd20069e9-cf67-41b9-8555-649630083a11', 'c2274839-7328-4170-8fd0-c9d5aa3491d8'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:01 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:01 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:02 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.885s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000442ef-9db5-4a25-acb2-78ff47f366f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d2cda-a6cd-4238-9f4b-946fbdfe6f12]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:02 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:53:02 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:02 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.806s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Deleted volume successfully. Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-830e8fbc-5deb-4ad2-aeab-e25878c010e9 tempest-CreateVolumesFromSourceVolumeTest-1263388072 None] Lock "cinder-5bba2a85-adc5-4bb5-aa2e-c7d857c98914-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:02 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.858s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:02 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:53:02 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:03 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.924s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:03 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487 Jul 07 22:53:03 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:04 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1.a5a47db4-8bf1-4997-9348-244d32daa487" returned: 0 in 0.809s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-a5a47db4-8bf1-4997-9348-244d32daa487" released by "_delete_snapshot" :: held 3.601s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" released by "delete_snapshot" :: held 3.631s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:04 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Created reservations ['f2adc6f6-5456-431f-82e1-4f0c5463d967', '21d36064-da14-4baa-9f20-15dc8c902086', 'b22bbf1d-8392-4462-b288-b6316fadb08a', '5334f91a-df15-4d55-ba26-d64a0edb0169'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Delete snapshot completed successfully. Jul 07 22:53:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f7174ebd-497f-4043-9402-807fe8c76d67 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-a5a47db4-8bf1-4997-9348-244d32daa487-delete_snapshot" released by "delete_snapshot" :: held 3.799s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-000442ef-9db5-4a25-acb2-78ff47f366f1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-000442ef-9db5-4a25-acb2-78ff47f366f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d2377-c7c5-4825-89b4-f0fcd30bec0f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:05 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:53:05 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:06 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.896s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:06 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1 Jul 07 22:53:06 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:07 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-000442ef-9db5-4a25-acb2-78ff47f366f1" returned: 0 in 0.724s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-000442ef-9db5-4a25-acb2-78ff47f366f1" released by "delete_volume" :: held 1.708s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Created reservations ['89df5aad-113c-4682-9eee-282736a809e4', '5bd12386-676b-475e-97b8-73caf6e14e8e', '247bd39d-98c6-4ef5-9948-5adea56316c5', 'ff928f4f-2764-4703-a9f7-56747d770f99'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:07 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:07 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-cb0e692f-a690-4943-9941-f207cb0639e3-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-cb0e692f-a690-4943-9941-f207cb0639e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8480d377-5266-4ab4-a17b-447a842418c1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:07 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 Jul 07 22:53:07 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:07 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:07 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Deleted volume successfully. Jul 07 22:53:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ab89a644-ab20-407c-a4e2-9342452493b6 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-000442ef-9db5-4a25-acb2-78ff47f366f1-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:08 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3" returned: 0 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:08 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3 Jul 07 22:53:08 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:09 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cb0e692f-a690-4943-9941-f207cb0639e3" returned: 0 in 0.878s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-quobyte-cb0e692f-a690-4943-9941-f207cb0639e3" released by "delete_volume" :: held 1.768s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Created reservations ['001c847f-e12a-4f58-b286-89ac7cacfb4c', 'e1e835f6-af07-4a33-8390-5fcaf5794cb9', 'a759afa2-c3f4-4f82-89a2-480853dfaa70', '67c7c4e5-7b6c-45e8-8449-a2658493d817'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:09 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:09 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:10 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.871s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:10 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Deleted volume successfully. Jul 07 22:53:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9880f355-1028-4da7-9cba-4ea26ce6dd68 tempest-VolumeDependencyTests-1840366374 None] Lock "cinder-cb0e692f-a690-4943-9941-f207cb0639e3-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:15 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:15 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:16 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.798s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:53:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:53:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:53:19 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:INSERT=21,cinder:UPDATE=74,cinder:SELECT=42,cinder:DELETE=8 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:53:20 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=97,cinder:SELECT=73,cinder:DELETE=7,cinder:INSERT=19 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (f7890f72-c1a3-4f3a-a50f-7f6731ced6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2346ec-bc76-4b2f-b5c4-54d3671eed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2346ec-bc76-4b2f-b5c4-54d3671eed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004563663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a085dfb7-b6e8-49f0-982a-dfb126de79c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:25Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a867eab-13c6-4b20-9b9e-004b64783f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a867eab-13c6-4b20-9b9e-004b64783f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41d52ec-1e09-4a82-815a-36c61e353179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41d52ec-1e09-4a82-815a-36c61e353179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a085dfb7-b6e8-49f0-982a-dfb126de79c6', 'volume_name': 'volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5820bf4d-bb3d-4c13-9787-e432bc4f388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5820bf4d-bb3d-4c13-9787-e432bc4f388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbb1751-92a0-4476-847c-304717d3be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:25 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Volume a085dfb7-b6e8-49f0-982a-dfb126de79c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6', 'volume_size': 1} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004563663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a085dfb7-b6e8-49f0-982a-dfb126de79c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:25Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Creating volume a085dfb7-b6e8-49f0-982a-dfb126de79c6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:25 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:53:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:25 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 1073741824 Jul 07 22:53:25 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:26 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 1073741824" returned: 0 in 0.970s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:26 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 Jul 07 22:53:26 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:27 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6" returned: 0 in 0.749s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbb1751-92a0-4476-847c-304717d3be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dab17f9-5927-48a6-aa87-d278547796f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Volume volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 (a085dfb7-b6e8-49f0-982a-dfb126de79c6): created successfully Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dab17f9-5927-48a6-aa87-d278547796f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (f7890f72-c1a3-4f3a-a50f-7f6731ced6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9e2ce0e7-7c55-4ea8-b933-a7c4f7825ae1 tempest-ProjectReaderTests-157379182 None] Created volume successfully. Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-a085dfb7-b6e8-49f0-982a-dfb126de79c6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "cinder-a085dfb7-b6e8-49f0-982a-dfb126de79c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Flow 'volume_create_manager' (a9408966-2cd8-4993-9cf2-7ff7b7bd396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8af0b7-7878-4c34-b41b-bd81e300b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8af0b7-7878-4c34-b41b-bd81e300b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-720226370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3e976c-0957-40ca-8159-cb7c4fe0185b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38807b046b84a009c9b3dbcee9522bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:28Z,use_quota=True,user_id='69bfe129aca146a8952c673d3a4cfb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a3350-a20a-4b49-9436-dc54606d03fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a3350-a20a-4b49-9436-dc54606d03fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c05cb3-8673-439c-a7de-8a45f998d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c05cb3-8673-439c-a7de-8a45f998d298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3e976c-0957-40ca-8159-cb7c4fe0185b', 'volume_name': 'volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e03f87-a66e-471f-b37f-89d9fcd1f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e03f87-a66e-471f-b37f-89d9fcd1f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17497ed-037b-4f53-8c28-a2e90d31754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Volume bf3e976c-0957-40ca-8159-cb7c4fe0185b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b', 'volume_size': 1} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-720226370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3e976c-0957-40ca-8159-cb7c4fe0185b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38807b046b84a009c9b3dbcee9522bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:28Z,use_quota=True,user_id='69bfe129aca146a8952c673d3a4cfb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Creating volume bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:27 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-quobyte-a085dfb7-b6e8-49f0-982a-dfb126de79c6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:27 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b 1073741824 Jul 07 22:53:27 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-a085dfb7-b6e8-49f0-982a-dfb126de79c6" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80af90-e79f-4b3e-b26c-f891b7d84259]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:28 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 Jul 07 22:53:28 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:28 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b 1073741824" returned: 0 in 0.809s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:28 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:28 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:28 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:28 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6 Jul 07 22:53:28 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:29 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a085dfb7-b6e8-49f0-982a-dfb126de79c6" returned: 0 in 0.631s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:29 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-a085dfb7-b6e8-49f0-982a-dfb126de79c6" released by "delete_volume" :: held 1.490s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.677s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17497ed-037b-4f53-8c28-a2e90d31754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be3136-f0b3-44f9-acdc-a84dd7d80309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Volume volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b (bf3e976c-0957-40ca-8159-cb7c4fe0185b): created successfully Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be3136-f0b3-44f9-acdc-a84dd7d80309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Flow 'volume_create_manager' (a9408966-2cd8-4993-9cf2-7ff7b7bd396e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b08d406b-54c3-4e99-96b1-aa42a37be12a tempest-SnapshotDependencyTests-1427280276 None] Created volume successfully. Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Created reservations ['7ed201fa-0b52-4997-8fe6-bd39879ebb92', '3ef3debd-6f94-48b4-afbf-497446341148', '6f221019-2114-49fd-b9cf-670a84a18079', '5230ecc9-573e-44c5-b276-d31cf6eb7bbb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:29 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:29 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Creating offline snapshot ecb92c29-d82a-48c6-80c3-52adadec0418 of volume bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32aab4b-a238-4e7c-9985-1bd50037b0d6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:30 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:30 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Deleted volume successfully. Jul 07 22:53:30 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-af0695fe-2f88-4e90-b9d1-68c5647144b3 tempest-ProjectReaderTests-157379182 None] Lock "cinder-a085dfb7-b6e8-49f0-982a-dfb126de79c6-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (44af93c6-67f0-4a60-b55c-8aff40852d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fd623-8a9c-4c5b-bcb3-592f58e1c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fd623-8a9c-4c5b-bcb3-592f58e1c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927947038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425cf553-f64a-42a6-b479-c365c1e0390c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:31Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb57c66-c78c-465b-afac-54b0c374fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb57c66-c78c-465b-afac-54b0c374fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3c1cb8-013d-409c-b101-97c818d063c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3c1cb8-013d-409c-b101-97c818d063c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425cf553-f64a-42a6-b479-c365c1e0390c', 'volume_name': 'volume-425cf553-f64a-42a6-b479-c365c1e0390c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d67390-7040-41cc-a452-3de2ec910d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d67390-7040-41cc-a452-3de2ec910d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c13b1-e722-410a-8644-67e4477be94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Volume 425cf553-f64a-42a6-b479-c365c1e0390c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425cf553-f64a-42a6-b479-c365c1e0390c', 'volume_size': 1} Jul 07 22:53:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:31 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.875s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:31 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 1G Jul 07 22:53:31 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:32 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 1G" returned: 0 in 0.856s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:32 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:32 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:32 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 is being set with open permissions: ugo+rw Jul 07 22:53:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:32 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:32 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:33 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.671s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:33 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info Jul 07 22:53:33 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:34 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info" returned: 0 in 0.675s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:34 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info is being set with open permissions: ugo+rw Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:34 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info Jul 07 22:53:34 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:34 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.info" returned: 0 in 0.660s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.104s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927947038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425cf553-f64a-42a6-b479-c365c1e0390c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:31Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Creating volume 425cf553-f64a-42a6-b479-c365c1e0390c {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:34 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:53:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:34 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c 1073741824 Jul 07 22:53:34 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a1e3cbda-ac11-4b7d-9e71-988a10424e92 tempest-SnapshotDependencyTests-1427280276 None] Create snapshot completed successfully Jul 07 22:53:35 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c 1073741824" returned: 0 in 0.899s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:35 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c Jul 07 22:53:35 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Flow 'volume_create_manager' (63e55053-41db-4f1f-8a96-dfbda70e32e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1bdc9c-c761-4ff9-98bd-6cdd4f10e3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1bdc9c-c761-4ff9-98bd-6cdd4f10e3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badba436-f8bb-454c-9f2e-e216a29f1ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38807b046b84a009c9b3dbcee9522bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecb92c29-d82a-48c6-80c3-52adadec0418,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:36Z,use_quota=True,user_id='69bfe129aca146a8952c673d3a4cfb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed2c666-7196-4118-9e69-98ecd9464ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed2c666-7196-4118-9e69-98ecd9464ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3cdee9-0a19-406b-9efa-5506d11ccfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3cdee9-0a19-406b-9efa-5506d11ccfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'badba436-f8bb-454c-9f2e-e216a29f1ef7', 'volume_name': 'volume-badba436-f8bb-454c-9f2e-e216a29f1ef7', 'volume_size': 1, 'snapshot_id': 'ecb92c29-d82a-48c6-80c3-52adadec0418'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3a2e4b-1e3c-40ec-adcd-0353acff4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3a2e4b-1e3c-40ec-adcd-0353acff4c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec333eb9-7c5b-49aa-be2f-8187285b881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Volume badba436-f8bb-454c-9f2e-e216a29f1ef7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-badba436-f8bb-454c-9f2e-e216a29f1ef7', 'volume_size': 1, 'snapshot_id': 'ecb92c29-d82a-48c6-80c3-52adadec0418'} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:36 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c" returned: 0 in 0.762s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.349s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418-badba436-f8bb-454c-9f2e-e216a29f1ef7" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c13b1-e722-410a-8644-67e4477be94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425cf553-f64a-42a6-b479-c365c1e0390c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c332e2a-8909-4b52-9f34-893fc948c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418-badba436-f8bb-454c-9f2e-e216a29f1ef7" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Creating volume badba436-f8bb-454c-9f2e-e216a29f1ef7 from snapshot ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Volume volume-425cf553-f64a-42a6-b479-c365c1e0390c (425cf553-f64a-42a6-b479-c365c1e0390c): created successfully Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c332e2a-8909-4b52-9f34-893fc948c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (44af93c6-67f0-4a60-b55c-8aff40852d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] snapshot: ecb92c29-d82a-48c6-80c3-52adadec0418, volume: badba436-f8bb-454c-9f2e-e216a29f1ef7, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:53:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c8421210-61b3-4dc8-96fe-665b627f3d5d tempest-ProjectReaderTests-157379182 None] Created volume successfully. Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a550c4a-77cb-4a60-8eff-53d26b104243]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:36 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:36 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-425cf553-f64a-42a6-b479-c365c1e0390c-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "cinder-425cf553-f64a-42a6-b479-c365c1e0390c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-quobyte-425cf553-f64a-42a6-b479-c365c1e0390c" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-425cf553-f64a-42a6-b479-c365c1e0390c" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8f5fa-5bc9-41f5-8270-84dab47a4a8a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:37 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c Jul 07 22:53:37 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:37 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.815s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a431ca-62e2-4142-90e2-ab5b0e986dba]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:37 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:37 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:38 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:38 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c Jul 07 22:53:38 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:38 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.862s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:38 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 Jul 07 22:53:38 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:38 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-425cf553-f64a-42a6-b479-c365c1e0390c" returned: 0 in 0.667s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-425cf553-f64a-42a6-b479-c365c1e0390c" released by "delete_volume" :: held 1.566s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Created reservations ['2d66d437-8f25-4140-98ca-292d99563cc4', '90736457-19db-4e04-82a3-43c30dae0398', '8a08806b-a404-4e1d-b918-f1a434aa8ee0', 'da729495-d911-45ac-898a-04a31d18f2eb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:38 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:38 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:39 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.018s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:39 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Deleted volume successfully. Jul 07 22:53:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fe8ce02d-3d25-4c7a-8aeb-3fa4d65b486c tempest-ProjectReaderTests-157379182 None] Lock "cinder-425cf553-f64a-42a6-b479-c365c1e0390c-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:40 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (c091b814-1ce3-4078-af9a-d3e122072a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6967cf77-cad6-42c8-b135-e559c91a804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6967cf77-cad6-42c8-b135-e559c91a804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526886017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4175cec8-a5db-4b85-a7e7-f8de796c8c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:41Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fa3ed-f2dd-4527-aab2-1e04bf413134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fa3ed-f2dd-4527-aab2-1e04bf413134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dcc07c-ef8b-4401-aa80-c21d59fb5850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dcc07c-ef8b-4401-aa80-c21d59fb5850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4175cec8-a5db-4b85-a7e7-f8de796c8c1b', 'volume_name': 'volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8c877-3945-4cdc-a42b-ac89774f233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8c877-3945-4cdc-a42b-ac89774f233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff48f51-1eba-43f0-8ae3-3e4380ddd58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Volume 4175cec8-a5db-4b85-a7e7-f8de796c8c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b', 'volume_size': 1} Jul 07 22:53:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:43 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7" returned: 0 in 5.280s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[55697c08-577f-43e1-b26a-7540ef9d4837]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:43 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:43 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:44 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.978s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:44 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:53:44 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Converted 1024.00 MB image at 193.90 MB/s Jul 07 22:53:44 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 is being set with open permissions: ugo+rw Jul 07 22:53:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:44 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 Jul 07 22:53:44 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:45 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" released by "_copy_volume_from_snapshot" :: held 8.749s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418-badba436-f8bb-454c-9f2e-e216a29f1ef7" released by "_create_volume_from_snapshot" :: held 8.799s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.834s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526886017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4175cec8-a5db-4b85-a7e7-f8de796c8c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:41Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Creating volume 4175cec8-a5db-4b85-a7e7-f8de796c8c1b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:45 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:45 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b 1073741824 Jul 07 22:53:45 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec333eb9-7c5b-49aa-be2f-8187285b881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badba436-f8bb-454c-9f2e-e216a29f1ef7', 'volume_size': 1, 'snapshot_id': 'ecb92c29-d82a-48c6-80c3-52adadec0418'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d145a88b-86b5-4de1-8108-b7040a4e0b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Volume volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 (badba436-f8bb-454c-9f2e-e216a29f1ef7): created successfully Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d145a88b-86b5-4de1-8108-b7040a4e0b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Flow 'volume_create_manager' (63e55053-41db-4f1f-8a96-dfbda70e32e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2a6754be-6761-4210-a90f-c240d9d3cdbc tempest-SnapshotDependencyTests-1427280276 None] Created volume successfully. Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-ecb92c29-d82a-48c6-80c3-52adadec0418-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-ecb92c29-d82a-48c6-80c3-52adadec0418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Deleting offline snapshot ecb92c29-d82a-48c6-80c3-52adadec0418 of volume bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] snapshot_file for this snap is: volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56dbf59-022d-4c34-a3f4-8a00714be268]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:46 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:46 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:46 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b 1073741824" returned: 0 in 0.916s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:46 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b Jul 07 22:53:46 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:46 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1fbe6-a764-47ee-a6c1-7b5f97567d5b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:47 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" returned: 0 in 0.689s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:47 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:47 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff48f51-1eba-43f0-8ae3-3e4380ddd58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a75042-b725-424b-b3d7-8a232bafc632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:47 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Volume volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b (4175cec8-a5db-4b85-a7e7-f8de796c8c1b): created successfully Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a75042-b725-424b-b3d7-8a232bafc632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (c091b814-1ce3-4078-af9a-d3e122072a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fe3c5749-c403-46db-bef3-fab477d69084 tempest-ProjectReaderTests-157379182 None] Created volume successfully. Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-4175cec8-a5db-4b85-a7e7-f8de796c8c1b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "cinder-4175cec8-a5db-4b85-a7e7-f8de796c8c1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-quobyte-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d4c2e-26fa-4ead-96fc-c256cf49d0ff]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:47 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b Jul 07 22:53:47 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:47 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.809s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:47 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:47 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:48 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" returned: 0 in 0.775s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:48 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b Jul 07 22:53:48 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:48 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:48 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418 Jul 07 22:53:48 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:48 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" returned: 0 in 0.688s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-4175cec8-a5db-4b85-a7e7-f8de796c8c1b" released by "delete_volume" :: held 1.508s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:48 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Created reservations ['cbe16cb4-fd41-49b4-8cfa-2cd7afbf5f31', '7e688eed-ca25-4507-86a9-9752648eb157', 'b29f4e71-05d4-44d7-9871-e08bd894346d', '780c3c2b-d5a7-4c8f-a488-df7414195003'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:49 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:49 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:49 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b.ecb92c29-d82a-48c6-80c3-52adadec0418" returned: 0 in 0.724s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-ecb92c29-d82a-48c6-80c3-52adadec0418" released by "_delete_snapshot" :: held 3.250s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" released by "delete_snapshot" :: held 3.281s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Created reservations ['a62293c3-023a-441a-b5e9-34dc5cf72322', '9dc56010-27d8-48a6-a1d0-30314229fea0', '4467e182-e743-48ff-a9a6-3a4d6e269768', '74d390da-9ca4-46f8-ad0c-27a1e75f2bd0'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Delete snapshot completed successfully. Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6af6a158-698a-4133-9be2-37f9c79bb641 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-ecb92c29-d82a-48c6-80c3-52adadec0418-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:49 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.699s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Deleted volume successfully. Jul 07 22:53:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-84e5787f-1477-447d-a117-6196967154d9 tempest-ProjectReaderTests-157379182 None] Lock "cinder-4175cec8-a5db-4b85-a7e7-f8de796c8c1b-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (2bbbd077-6b20-43eb-9c6f-e3364f6a852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6413bb74-8d81-4e13-b51b-9cd5707d4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6413bb74-8d81-4e13-b51b-9cd5707d4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007134617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88888031-df41-4f02-9c0c-d36b40536e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:50Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f292dc-e1a1-4115-8c50-07f80efbe21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f292dc-e1a1-4115-8c50-07f80efbe21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a5c483-3212-4220-8245-c25bf8405dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a5c483-3212-4220-8245-c25bf8405dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88888031-df41-4f02-9c0c-d36b40536e50', 'volume_name': 'volume-88888031-df41-4f02-9c0c-d36b40536e50', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e58a21-ac98-431b-b39f-bc0a7060e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e58a21-ac98-431b-b39f-bc0a7060e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c67d57-0708-4ee7-a3ac-3e0a8d9aabe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:50 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Volume 88888031-df41-4f02-9c0c-d36b40536e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88888031-df41-4f02-9c0c-d36b40536e50', 'volume_size': 1} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007134617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88888031-df41-4f02-9c0c-d36b40536e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cd8cd1e00546dd96f6b9084da5eee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:50Z,use_quota=True,user_id='4ce52069bfc340c09e68603fef26b818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Creating volume 88888031-df41-4f02-9c0c-d36b40536e50 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:50 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:50 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 1073741824 Jul 07 22:53:50 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-bf3e976c-0957-40ca-8159-cb7c4fe0185b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-bf3e976c-0957-40ca-8159-cb7c4fe0185b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" acquired by "delete_volume" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e824faa-9262-440e-8a59-928c30311027]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:50 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:50 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:51 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 1073741824" returned: 0 in 0.938s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:51 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 Jul 07 22:53:51 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:51 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.867s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:51 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b Jul 07 22:53:51 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:51 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50" returned: 0 in 0.691s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c67d57-0708-4ee7-a3ac-3e0a8d9aabe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88888031-df41-4f02-9c0c-d36b40536e50', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146dd42c-40ff-4e51-9123-73b0e7baf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Volume volume-88888031-df41-4f02-9c0c-d36b40536e50 (88888031-df41-4f02-9c0c-d36b40536e50): created successfully Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146dd42c-40ff-4e51-9123-73b0e7baf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Flow 'volume_create_manager' (2bbbd077-6b20-43eb-9c6f-e3364f6a852c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-65ce4390-b97d-409a-aa84-0f280be93a5b tempest-ProjectReaderTests-157379182 None] Created volume successfully. Jul 07 22:53:51 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bf3e976c-0957-40ca-8159-cb7c4fe0185b" returned: 0 in 0.698s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-bf3e976c-0957-40ca-8159-cb7c4fe0185b" released by "delete_volume" :: held 1.627s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Created reservations ['a5a595c8-bbdc-462d-bc5f-4cee28f935f7', 'bfc141c7-7f0f-425d-8924-7538177d4b23', '3d33d19c-e404-4307-84b4-ccf82bfd2db9', 'f6789f15-1b8e-4578-8df9-729fcf8aecba'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:52 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:52 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-88888031-df41-4f02-9c0c-d36b40536e50-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "cinder-88888031-df41-4f02-9c0c-d36b40536e50-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Acquiring lock "cinder-quobyte-88888031-df41-4f02-9c0c-d36b40536e50" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-88888031-df41-4f02-9c0c-d36b40536e50" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb74fd-3174-44f7-80e2-2aae2b6d93c9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-badba436-f8bb-454c-9f2e-e216a29f1ef7-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:52 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 Jul 07 22:53:52 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-badba436-f8bb-454c-9f2e-e216a29f1ef7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f0fa37-9f75-4707-904e-4342ba436327]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:52 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 Jul 07 22:53:52 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:52 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.762s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Deleted volume successfully. Jul 07 22:53:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e3f18c38-9d68-434c-b798-c4f3634903bc tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-bf3e976c-0957-40ca-8159-cb7c4fe0185b-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:53 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:53 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50 Jul 07 22:53:53 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:53 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7" returned: 0 in 0.859s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:53 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7 Jul 07 22:53:53 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:53 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-88888031-df41-4f02-9c0c-d36b40536e50" returned: 0 in 0.709s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "cinder-quobyte-88888031-df41-4f02-9c0c-d36b40536e50" released by "delete_volume" :: held 1.582s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:53 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Created reservations ['d122d436-c4b1-4536-87b8-da3a9805c674', '49894142-496f-4717-8df6-4af8a80ef880', '2428a8ff-7b83-4751-a742-6b3f30682f19', '0ce54ebd-7487-4565-8c2a-3c8e0530d513'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:54 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:54 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:54 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-badba436-f8bb-454c-9f2e-e216a29f1ef7" returned: 0 in 0.690s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-quobyte-badba436-f8bb-454c-9f2e-e216a29f1ef7" released by "delete_volume" :: held 1.591s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Created reservations ['6b9ffcb8-3c17-4c64-82fb-b6f2b53b0df4', 'ac39cb03-0e78-4f88-8ae4-0eff0051a97b', 'ee927c06-1b7f-4e09-be73-ee2645264a81', '6ecf572a-9bc8-4328-a644-3cfe3d862750'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:54 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:53:54 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:54 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.796s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Deleted volume successfully. Jul 07 22:53:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c27cade4-ca7d-4997-ab27-e174130714b4 tempest-ProjectReaderTests-157379182 None] Lock "cinder-88888031-df41-4f02-9c0c-d36b40536e50-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:55 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.832s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:55 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Deleted volume successfully. Jul 07 22:53:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5644297a-8a04-4c51-8448-dcfc833d6592 tempest-SnapshotDependencyTests-1427280276 None] Lock "cinder-badba436-f8bb-454c-9f2e-e216a29f1ef7-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:04 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=52,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=6 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:54:05 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=71,cinder:SELECT=51,cinder:INSERT=17,cinder:DELETE=7 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Flow 'volume_create_manager' (6a845807-6e04-4e1a-b077-ef3a54c26b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fea7cf-7f66-4a97-8787-b200776d4a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fea7cf-7f66-4a97-8787-b200776d4a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edce841-a5d6-49bc-987c-47e2317adbab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d7a1cd9e84e1db957e8c03fcf1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:15Z,use_quota=True,user_id='97454903b65e43399bec6e5b7d48fceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dff17b9-1a1c-4f35-8062-df541484e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dff17b9-1a1c-4f35-8062-df541484e13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed619af-481c-4fa6-89c9-d7bb2b5b80c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed619af-481c-4fa6-89c9-d7bb2b5b80c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edce841-a5d6-49bc-987c-47e2317adbab', 'volume_name': 'volume-5edce841-a5d6-49bc-987c-47e2317adbab', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c25440-19fd-4fb8-830c-11446b4e74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c25440-19fd-4fb8-830c-11446b4e74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccb8406-f316-49e1-8fe5-e99f3073edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Volume 5edce841-a5d6-49bc-987c-47e2317adbab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edce841-a5d6-49bc-987c-47e2317adbab', 'volume_size': 1} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edce841-a5d6-49bc-987c-47e2317adbab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d7a1cd9e84e1db957e8c03fcf1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:15Z,use_quota=True,user_id='97454903b65e43399bec6e5b7d48fceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Creating volume 5edce841-a5d6-49bc-987c-47e2317adbab {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:15 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:15 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab 1073741824 Jul 07 22:54:15 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (db170399-8a6a-493c-8374-0a2df77036fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c873a-0c53-4211-9eca-5646f0c8245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c873a-0c53-4211-9eca-5646f0c8245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587381063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc8851-3576-41e8-8d94-51f8c13fc220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:15Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02b8d6c-a841-4a37-bdf3-c75948d188ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:15 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02b8d6c-a841-4a37-bdf3-c75948d188ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3add80-bc83-48c2-abdf-cbf1ed7890c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3add80-bc83-48c2-abdf-cbf1ed7890c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cc8851-3576-41e8-8d94-51f8c13fc220', 'volume_name': 'volume-f0cc8851-3576-41e8-8d94-51f8c13fc220', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5548d84d-ac96-4592-9083-bdfc2e851631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5548d84d-ac96-4592-9083-bdfc2e851631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45fa57e-8ed6-498d-abcb-553522a543db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume f0cc8851-3576-41e8-8d94-51f8c13fc220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cc8851-3576-41e8-8d94-51f8c13fc220', 'volume_size': 1} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (78543a5b-f412-4016-b125-7184247e9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f028bcaf-8570-40ed-89ff-236d1847d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f028bcaf-8570-40ed-89ff-236d1847d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730543779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb26d58-ea98-4b87-8df4-8f130c59994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:16Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797abc2c-2847-46bf-949f-ae30a1238490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797abc2c-2847-46bf-949f-ae30a1238490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4051353-5478-49c0-8485-77e098206bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4051353-5478-49c0-8485-77e098206bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb26d58-ea98-4b87-8df4-8f130c59994e', 'volume_name': 'volume-3eb26d58-ea98-4b87-8df4-8f130c59994e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e78c31-0314-4d5b-8dce-844658ea7dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e78c31-0314-4d5b-8dce-844658ea7dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b6d56e-9033-48b4-ac11-8583694d729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Volume 3eb26d58-ea98-4b87-8df4-8f130c59994e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb26d58-ea98-4b87-8df4-8f130c59994e', 'volume_size': 1} Jul 07 22:54:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (5060b8f5-d9ff-4fdd-b72a-ec8f35049387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da26cb39-adec-48f1-8bf7-c423d16e0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:16 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.060s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da26cb39-adec-48f1-8bf7-c423d16e0bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169911882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c63aaab-8b60-4d02-a21c-c50005e4184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:16Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cd0541-0e92-4c10-8836-973604f6e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cd0541-0e92-4c10-8836-973604f6e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4bd8fe-d992-46b0-993d-f3422106e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:16 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4bd8fe-d992-46b0-993d-f3422106e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c63aaab-8b60-4d02-a21c-c50005e4184a', 'volume_name': 'volume-5c63aaab-8b60-4d02-a21c-c50005e4184a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df18a0b-8f31-46a4-b56c-3a9ca4d709dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df18a0b-8f31-46a4-b56c-3a9ca4d709dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f94f9f-282c-4306-808f-4ff557304392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:16 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Volume 5c63aaab-8b60-4d02-a21c-c50005e4184a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c63aaab-8b60-4d02-a21c-c50005e4184a', 'volume_size': 1} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab 1073741824" returned: 0 in 1.235s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:54:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:16 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab Jul 07 22:54:16 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (818f6ad5-5730-4072-87fc-1036021eb28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ae3f3-6088-42bf-aade-f741a917c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ae3f3-6088-42bf-aade-f741a917c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004120641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e281ab-382c-463a-9099-1030d3f8e8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:17Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274361a-2793-4574-9273-25f15b264dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274361a-2793-4574-9273-25f15b264dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7040a-8d03-4c93-81ce-69e0e7cd60b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7040a-8d03-4c93-81ce-69e0e7cd60b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e281ab-382c-463a-9099-1030d3f8e8e5', 'volume_name': 'volume-70e281ab-382c-463a-9099-1030d3f8e8e5', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ed13fd-09cd-40ca-bc1a-d154dc176f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ed13fd-09cd-40ca-bc1a-d154dc176f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8525dc09-3922-4daa-9141-6923261474ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Volume 70e281ab-382c-463a-9099-1030d3f8e8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e281ab-382c-463a-9099-1030d3f8e8e5', 'volume_size': 1} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:17 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab" returned: 0 in 0.743s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587381063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc8851-3576-41e8-8d94-51f8c13fc220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:15Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:17 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:17 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 1073741824 Jul 07 22:54:17 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccb8406-f316-49e1-8fe5-e99f3073edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edce841-a5d6-49bc-987c-47e2317adbab', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b70387b-17d9-4dd1-bbc2-c25d0846d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (7ad7fe65-a3cd-42c4-8251-f12142787512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c2fc1a-8ac8-4c78-b6c3-cebfd7f4ef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Volume volume-5edce841-a5d6-49bc-987c-47e2317adbab (5edce841-a5d6-49bc-987c-47e2317adbab): created successfully Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b70387b-17d9-4dd1-bbc2-c25d0846d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Flow 'volume_create_manager' (6a845807-6e04-4e1a-b077-ef3a54c26b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c2fc1a-8ac8-4c78-b6c3-cebfd7f4ef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084930768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5690f6-2c45-45b2-ad51-4503822dc185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:17Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8024e707-4ef3-427b-b7b4-c53a4bc088ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8024e707-4ef3-427b-b7b4-c53a4bc088ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7826e7a-e4d5-42fd-b57c-91cc0b1f7953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7826e7a-e4d5-42fd-b57c-91cc0b1f7953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5690f6-2c45-45b2-ad51-4503822dc185', 'volume_name': 'volume-7d5690f6-2c45-45b2-ad51-4503822dc185', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f763d6b2-e93d-4a0c-bd99-25f156bf7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f763d6b2-e93d-4a0c-bd99-25f156bf7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcf6f0b-83cf-4f8a-aa80-86b0d66b410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:17 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Volume 7d5690f6-2c45-45b2-ad51-4503822dc185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5690f6-2c45-45b2-ad51-4503822dc185', 'volume_size': 1} Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-722a6f92-af4f-47bd-a4c1-f6da60a15c05 tempest-CinderUnicodeTest-233133527 None] Created volume successfully. Jul 07 22:54:17 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (17d1d9c0-69d4-4c04-99cd-f3f104a48873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52100cee-b475-40cb-9878-82aa46d106ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52100cee-b475-40cb-9878-82aa46d106ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1598517364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd96c4-2269-4230-873d-926a49b724a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:18Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7ca065-2c95-4f0a-bf69-a4ea9d9650e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7ca065-2c95-4f0a-bf69-a4ea9d9650e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f71aedb-06b4-4c0b-a139-01a355405edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f71aedb-06b4-4c0b-a139-01a355405edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcd96c4-2269-4230-873d-926a49b724a6', 'volume_name': 'volume-8fcd96c4-2269-4230-873d-926a49b724a6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70cff7e-7918-4011-93ca-fc875dfe2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70cff7e-7918-4011-93ca-fc875dfe2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2230f0ae-7a71-4332-947e-4d4eb16e06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:18 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Volume 8fcd96c4-2269-4230-873d-926a49b724a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcd96c4-2269-4230-873d-926a49b724a6', 'volume_size': 1} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:18 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 1073741824" returned: 0 in 1.091s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:18 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 Jul 07 22:54:18 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Flow 'volume_create_manager' (c4309262-8608-45dd-8bfa-8c6f63a6b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67e88ab-5099-4a60-b1ef-0452e0291b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67e88ab-5099-4a60-b1ef-0452e0291b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1633799878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd208641-afc9-481a-9a04-d9114f963069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d7a1cd9e84e1db957e8c03fcf1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:19Z,use_quota=True,user_id='97454903b65e43399bec6e5b7d48fceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e1031f-f9d1-4c84-b8af-75a7f2ecacc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e1031f-f9d1-4c84-b8af-75a7f2ecacc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3219d2b7-1dcf-4dd9-bad0-95303f165bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3219d2b7-1dcf-4dd9-bad0-95303f165bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd208641-afc9-481a-9a04-d9114f963069', 'volume_name': 'volume-cd208641-afc9-481a-9a04-d9114f963069', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e55f75-fa4a-4d04-807c-164f0586b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e55f75-fa4a-4d04-807c-164f0586b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eed193-3942-4170-a1ea-a8146b133905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Volume cd208641-afc9-481a-9a04-d9114f963069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd208641-afc9-481a-9a04-d9114f963069', 'volume_size': 1} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:19 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220" returned: 0 in 0.924s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-730543779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb26d58-ea98-4b87-8df4-8f130c59994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:16Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Creating volume 3eb26d58-ea98-4b87-8df4-8f130c59994e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:19 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:19 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e 1073741824 Jul 07 22:54:19 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45fa57e-8ed6-498d-abcb-553522a543db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cc8851-3576-41e8-8d94-51f8c13fc220', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad82c9c3-5da9-42fe-bb30-1c0a54a0d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 (f0cc8851-3576-41e8-8d94-51f8c13fc220): created successfully Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad82c9c3-5da9-42fe-bb30-1c0a54a0d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (db170399-8a6a-493c-8374-0a2df77036fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:19 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6a595383-4b77-4a0d-af51-cc03f4f481e8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Flow 'volume_create_manager' (6a21392d-d243-4248-97c1-20f89c79a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ec10f-6789-42e3-bc7d-39c72ef6d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ec10f-6789-42e3-bc7d-39c72ef6d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e300e9f-1de0-4dc0-a000-b89ee2b41ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aeeb4465c1498fad87e659b3419c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:20Z,use_quota=True,user_id='05785033a00a4794834abf0038f7a1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57e1f0d0-ced1-4a74-a337-9478c66f207e),volume_type_id=57e1f0d0-ced1-4a74-a337-9478c66f207e)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891de5e-2f04-45df-af4d-220ae13e8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891de5e-2f04-45df-af4d-220ae13e8378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b3ca12-c8c7-4896-9923-bc46b56d822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b3ca12-c8c7-4896-9923-bc46b56d822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e300e9f-1de0-4dc0-a000-b89ee2b41ba0', 'volume_name': 'volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0', 'volume_size': 1, 'image_id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7007fd35d02d5c6980d8b92d7016c935', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77aeeb4465c1498fad87e659b3419c79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a727637670f4fa3c039f888b4a260e5f2dc106007264456d3ce944785db416d002ea7242badec88d4ec653353849bee3eb360f9ceae50fc0c068d73fd06387a', 'id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'created_at': datetime.datetime(2026, 7, 7, 20, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 54, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea71346-4152-422c-8981-c8899229e701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea71346-4152-422c-8981-c8899229e701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53569b83-c466-47bc-bdfe-3d98f2da7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:19 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0', 'volume_size': 1, 'image_id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7007fd35d02d5c6980d8b92d7016c935', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77aeeb4465c1498fad87e659b3419c79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a727637670f4fa3c039f888b4a260e5f2dc106007264456d3ce944785db416d002ea7242badec88d4ec653353849bee3eb360f9ceae50fc0c068d73fd06387a', 'id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'created_at': datetime.datetime(2026, 7, 7, 20, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 54, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:54:19 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Trying to clone 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 from image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:54:20 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcaf318-6b48-47ea-9d8c-473a80299110]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:20 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:20 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:20 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e 1073741824" returned: 0 in 0.882s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:20 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e Jul 07 22:54:20 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:21 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:21 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:21 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:21 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e" returned: 0 in 0.762s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.605s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169911882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c63aaab-8b60-4d02-a21c-c50005e4184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:16Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Creating volume 5c63aaab-8b60-4d02-a21c-c50005e4184a {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:21 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:21 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a 1073741824 Jul 07 22:54:21 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b6d56e-9033-48b4-ac11-8583694d729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb26d58-ea98-4b87-8df4-8f130c59994e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964de934-0074-4355-ade2-a4f05feb8a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:21 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Volume volume-3eb26d58-ea98-4b87-8df4-8f130c59994e (3eb26d58-ea98-4b87-8df4-8f130c59994e): created successfully Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964de934-0074-4355-ade2-a4f05feb8a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (78543a5b-f412-4016-b125-7184247e9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:21 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-13675151-f37c-4b33-853e-5948cf254126 tempest-CreateVolumesFromImageTest-1622604046 None] Created volume successfully. Jul 07 22:54:21 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 1 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Temporary image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 is fetched for user 05785033a00a4794834abf0038f7a1d9. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6c7c2-5bae-4b97-a2e2-f3d2c49504c0]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:22 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:22 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:22 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a 1073741824" returned: 0 in 1.088s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:22 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a Jul 07 22:54:22 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:22 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:22 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:22 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:23 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.949s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004120641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e281ab-382c-463a-9099-1030d3f8e8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:17Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Creating volume 70e281ab-382c-463a-9099-1030d3f8e8e5 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:23 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:23 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 1073741824 Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f94f9f-282c-4306-808f-4ff557304392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c63aaab-8b60-4d02-a21c-c50005e4184a', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48661911-6431-408c-9323-ce08e344b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Volume volume-5c63aaab-8b60-4d02-a21c-c50005e4184a (5c63aaab-8b60-4d02-a21c-c50005e4184a): created successfully Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48661911-6431-408c-9323-ce08e344b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (5060b8f5-d9ff-4fdd-b72a-ec8f35049387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-98b6fe43-cefd-44b8-8b25-d87004b1b312 tempest-CreateVolumesFromImageTest-1622604046 None] Created volume successfully. Jul 07 22:54:23 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 1 in 0.934s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:24 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 1073741824" returned: 0 in 1.050s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:24 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 Jul 07 22:54:24 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:25 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5" returned: 0 in 0.694s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.318s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084930768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5690f6-2c45-45b2-ad51-4503822dc185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:17Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Creating volume 7d5690f6-2c45-45b2-ad51-4503822dc185 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:25 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:25 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 1073741824 Jul 07 22:54:25 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8525dc09-3922-4daa-9141-6923261474ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e281ab-382c-463a-9099-1030d3f8e8e5', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550bca8e-7c8a-4f37-a4ee-859abde7a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:25 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Volume volume-70e281ab-382c-463a-9099-1030d3f8e8e5 (70e281ab-382c-463a-9099-1030d3f8e8e5): created successfully Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550bca8e-7c8a-4f37-a4ee-859abde7a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (818f6ad5-5730-4072-87fc-1036021eb28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-de4e221f-e661-47af-9c53-ca5106209c64 tempest-CreateVolumesFromImageTest-1622604046 None] Created volume successfully. Jul 07 22:54:25 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 1073741824" returned: 0 in 0.837s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:25 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 Jul 07 22:54:25 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:26 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.510s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1598517364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcd96c4-2269-4230-873d-926a49b724a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de724da5e4a4ae093d8bb02a2ea39fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:18Z,use_quota=True,user_id='03f9bad378774c08b422f3e974bcdb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Creating volume 8fcd96c4-2269-4230-873d-926a49b724a6 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:26 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:26 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 1073741824 Jul 07 22:54:26 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcf6f0b-83cf-4f8a-aa80-86b0d66b410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5690f6-2c45-45b2-ad51-4503822dc185', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5346377-440a-42f2-9399-af4eb0a3a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:26 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Volume volume-7d5690f6-2c45-45b2-ad51-4503822dc185 (7d5690f6-2c45-45b2-ad51-4503822dc185): created successfully Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5346377-440a-42f2-9399-af4eb0a3a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:26 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (7ad7fe65-a3cd-42c4-8251-f12142787512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bf2276ca-3bee-48be-9a74-7e7a923ff055 tempest-CreateVolumesFromImageTest-1622604046 None] Created volume successfully. Jul 07 22:54:27 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 1073741824" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:27 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 Jul 07 22:54:27 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:28 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6" returned: 0 in 0.671s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.848s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1633799878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd208641-afc9-481a-9a04-d9114f963069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29d7a1cd9e84e1db957e8c03fcf1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:19Z,use_quota=True,user_id='97454903b65e43399bec6e5b7d48fceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Creating volume cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:28 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2230f0ae-7a71-4332-947e-4d4eb16e06aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcd96c4-2269-4230-873d-926a49b724a6', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:28 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 1073741824 Jul 07 22:54:28 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f8a34-c7b0-4040-8c0a-a9602a1712d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:28 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Volume volume-8fcd96c4-2269-4230-873d-926a49b724a6 (8fcd96c4-2269-4230-873d-926a49b724a6): created successfully Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f8a34-c7b0-4040-8c0a-a9602a1712d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Flow 'volume_create_manager' (17d1d9c0-69d4-4c04-99cd-f3f104a48873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f85baa79-fe52-4617-b866-4faf3a86a4c5 tempest-CreateVolumesFromImageTest-1622604046 None] Created volume successfully. Jul 07 22:54:28 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 1073741824" returned: 0 in 0.835s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:29 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 Jul 07 22:54:29 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-8fcd96c4-2269-4230-873d-926a49b724a6-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-8fcd96c4-2269-4230-873d-926a49b724a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-quobyte-8fcd96c4-2269-4230-873d-926a49b724a6" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-8fcd96c4-2269-4230-873d-926a49b724a6" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4436923-b956-42cf-b9f3-04c7ed782f79]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:29 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 Jul 07 22:54:29 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:29 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069" returned: 0 in 0.703s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.803s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eed193-3942-4170-a1ea-a8146b133905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd208641-afc9-481a-9a04-d9114f963069', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901545e-73f7-4368-b0e9-b7ea4a287ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating offline snapshot b8f9bba3-ce3a-4c59-badf-a46ec56fc32f of volume f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Volume volume-cd208641-afc9-481a-9a04-d9114f963069 (cd208641-afc9-481a-9a04-d9114f963069): created successfully Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901545e-73f7-4368-b0e9-b7ea4a287ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Flow 'volume_create_manager' (c4309262-8608-45dd-8bfa-8c6f63a6b87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d036b0a-0d4b-4de3-aecd-4f9f6d9e2360]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8f915c61-cced-457d-998b-7fb7e1a7862a tempest-CinderUnicodeTest-233133527 None] Created volume successfully. Jul 07 22:54:29 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 Jul 07 22:54:29 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:29 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6" returned: 0 in 0.791s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:30 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6 Jul 07 22:54:30 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:30 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220" returned: 0 in 0.789s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:30 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f 1G Jul 07 22:54:30 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:30 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8fcd96c4-2269-4230-873d-926a49b724a6" returned: 0 in 0.693s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-8fcd96c4-2269-4230-873d-926a49b724a6" released by "delete_volume" :: held 1.537s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Created reservations ['b8932327-1907-4a87-93ac-8394edb4d838', 'b606b5ea-261d-495e-b65d-a164767cde4e', '47b8b8ee-5179-4c7a-b8c6-50bf163f51ad', '9d17191e-f4ce-464e-a00e-d19f62a5296d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:30 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:30 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-7d5690f6-2c45-45b2-ad51-4503822dc185-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-7d5690f6-2c45-45b2-ad51-4503822dc185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-quobyte-7d5690f6-2c45-45b2-ad51-4503822dc185" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-7d5690f6-2c45-45b2-ad51-4503822dc185" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:31 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f 1G" returned: 0 in 0.894s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0060bc6-cf0c-4095-b3c3-3477b3fbd72d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:31 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f Jul 07 22:54:31 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:31 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 Jul 07 22:54:31 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:31 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Deleted volume successfully. Jul 07 22:54:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff6e9274-0bc1-4e0f-8503-79d9ffe4ae81 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-8fcd96c4-2269-4230-873d-926a49b724a6-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:32 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" returned: 0 in 0.714s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f is being set with open permissions: ugo+rw Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:32 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f Jul 07 22:54:32 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:32 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185" returned: 0 in 0.823s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:32 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185 Jul 07 22:54:32 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:32 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" returned: 0 in 0.661s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:32 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info Jul 07 22:54:32 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:32 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7d5690f6-2c45-45b2-ad51-4503822dc185" returned: 0 in 0.705s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-7d5690f6-2c45-45b2-ad51-4503822dc185" released by "delete_volume" :: held 1.579s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Created reservations ['96078536-1aaf-4799-b9cf-6e45f834eff6', 'f79e52ba-86f3-4833-8610-5951bd2e011d', 'fde8700d-10bb-4a0f-96b7-488bc9abeb66', 'ab918a08-c47d-446a-9527-a9ad9032313f'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:33 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:33 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:33 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info" returned: 0 in 0.677s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:33 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info is being set with open permissions: ugo+rw Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:33 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info Jul 07 22:54:33 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-70e281ab-382c-463a-9099-1030d3f8e8e5-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-70e281ab-382c-463a-9099-1030d3f8e8e5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-quobyte-70e281ab-382c-463a-9099-1030d3f8e8e5" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-70e281ab-382c-463a-9099-1030d3f8e8e5" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648e2cf-fc39-43fa-8b5c-17c158b9cd06]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:33 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Deleted volume successfully. Jul 07 22:54:33 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 Jul 07 22:54:33 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b19e72eb-0aee-4e23-96e9-a4535fe942e5 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-7d5690f6-2c45-45b2-ad51-4503822dc185-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:34 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.info" returned: 0 in 0.673s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.538s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.473s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e300e9f-1de0-4dc0-a000-b89ee2b41ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aeeb4465c1498fad87e659b3419c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:20Z,use_quota=True,user_id='05785033a00a4794834abf0038f7a1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57e1f0d0-ced1-4a74-a337-9478c66f207e),volume_type_id=57e1f0d0-ced1-4a74-a337-9478c66f207e)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Creating volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:34 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:34 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1073741824 Jul 07 22:54:34 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cf18c361-8dea-4687-a5b9-0118dcf462d9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Create snapshot completed successfully Jul 07 22:54:34 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5" returned: 0 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:34 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5 Jul 07 22:54:34 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (89c6ca51-3a1c-4b4c-b008-7f5b091fba10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927a207-aa1a-4234-a976-429289a5165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927a207-aa1a-4234-a976-429289a5165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834200210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15933f33-7f8f-4198-be9e-c3771db0b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:35Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bb0164-76cf-41f8-bcef-1f67fcc89607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bb0164-76cf-41f8-bcef-1f67fcc89607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2658e2-2665-4873-90fe-8b3646667cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2658e2-2665-4873-90fe-8b3646667cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15933f33-7f8f-4198-be9e-c3771db0b8d9', 'volume_name': 'volume-15933f33-7f8f-4198-be9e-c3771db0b8d9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d7425-6da0-4028-8aed-79b727205cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d7425-6da0-4028-8aed-79b727205cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e319b0cd-fed6-40ae-bb24-87cb1a2622e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume 15933f33-7f8f-4198-be9e-c3771db0b8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15933f33-7f8f-4198-be9e-c3771db0b8d9', 'volume_size': 1} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:35 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1073741824" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:35 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-70e281ab-382c-463a-9099-1030d3f8e8e5" returned: 0 in 0.748s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-70e281ab-382c-463a-9099-1030d3f8e8e5" released by "delete_volume" :: held 1.602s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:35 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:35 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (50db2822-8570-4b37-a78f-61245c5e7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1501506c-5488-4303-a875-969e07ca75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1501506c-5488-4303-a875-969e07ca75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35280057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f6af17-adfc-4d39-9842-674af8a7d543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:35Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f1d8b4-0ebd-4b03-917d-b10548487aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f1d8b4-0ebd-4b03-917d-b10548487aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ce76be-2fc0-4e5a-a5cf-b0bbb0dec1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ce76be-2fc0-4e5a-a5cf-b0bbb0dec1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f6af17-adfc-4d39-9842-674af8a7d543', 'volume_name': 'volume-27f6af17-adfc-4d39-9842-674af8a7d543', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c83ec8-853b-4e12-b3c6-3a579912b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c83ec8-853b-4e12-b3c6-3a579912b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf165d3b-eabf-46ab-bddc-8997521c7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume 27f6af17-adfc-4d39-9842-674af8a7d543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f6af17-adfc-4d39-9842-674af8a7d543', 'volume_size': 1} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Created reservations ['2e0612c1-a68f-4614-a488-e4d3d47616f3', '94ed54c2-93f9-4781-9c3a-c6d4b52770f1', 'b27be103-a6f9-424f-b9b8-82ee58f6593d', '2c4f6f87-7360-4fc1-b2cc-5632c37812b5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:35 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:35 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (9d2075d8-6d43-485d-91a7-0880935cb7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc65b7c-8154-4907-a2bd-0014fbf33617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc65b7c-8154-4907-a2bd-0014fbf33617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856212181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233457c7-35dd-47bb-bb5f-2f6891f5b298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:36Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a972a6fc-8693-4802-9733-123ca53cef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a972a6fc-8693-4802-9733-123ca53cef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d96d7df-3f21-48d1-a690-c446369c05f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d96d7df-3f21-48d1-a690-c446369c05f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233457c7-35dd-47bb-bb5f-2f6891f5b298', 'volume_name': 'volume-233457c7-35dd-47bb-bb5f-2f6891f5b298', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695da035-50ec-4969-8877-1233a12a539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695da035-50ec-4969-8877-1233a12a539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953eb0f7-09d2-4058-8aa2-0f7c39daea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume 233457c7-35dd-47bb-bb5f-2f6891f5b298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233457c7-35dd-47bb-bb5f-2f6891f5b298', 'volume_size': 1} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-5c63aaab-8b60-4d02-a21c-c50005e4184a-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-5c63aaab-8b60-4d02-a21c-c50005e4184a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-quobyte-5c63aaab-8b60-4d02-a21c-c50005e4184a" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-5c63aaab-8b60-4d02-a21c-c50005e4184a" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a543659-3e3b-4122-a678-3a7c5c0458b9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:36 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a Jul 07 22:54:36 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 0 in 1.036s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.220s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Creating offline snapshot 97424346-b359-491b-a6b9-f65469d17828 of volume cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2f463-5c65-437d-8be3-ff89b7cd32f3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:36 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Attempting download of 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}])) to volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.853s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Deleted volume successfully. Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (b0862676-f6c1-49e6-8897-2da286ccd96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd049c5-c828-4425-8e84-099500dce474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd049c5-c828-4425-8e84-099500dce474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004205459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b146b55-bedf-46e5-9107-86e8c4613bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:36Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a304b-1dbc-4233-859e-4d0f023bf451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a304b-1dbc-4233-859e-4d0f023bf451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd4420-344a-4716-b70c-cfbfea23ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd4420-344a-4716-b70c-cfbfea23ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b146b55-bedf-46e5-9107-86e8c4613bc8', 'volume_name': 'volume-8b146b55-bedf-46e5-9107-86e8c4613bc8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ed263-1b59-420a-9e2d-6828ab920a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ed263-1b59-420a-9e2d-6828ab920a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:36 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 Jul 07 22:54:36 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e54578-47ba-4745-8ced-43b93bfddb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume 8b146b55-bedf-46e5-9107-86e8c4613bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b146b55-bedf-46e5-9107-86e8c4613bc8', 'volume_size': 1} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f911bc46-b7b7-40e5-b103-cd65b8c5b7fe]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4ca8317c-efb1-48d7-bf2f-59bc730d3edd tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-70e281ab-382c-463a-9099-1030d3f8e8e5-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:36 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l Jul 07 22:54:36 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:37 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (de4e757e-0408-4511-99d0-e9bf616f1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b43105-6024-4470-9dc0-70fec4470eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a" returned: 0 in 1.056s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:37 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a Jul 07 22:54:37 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b43105-6024-4470-9dc0-70fec4470eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553882128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801b839-aa7f-4f4c-83bb-02facdbc5419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:37Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a01ca4-18f3-469f-b747-facaea9301dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a01ca4-18f3-469f-b747-facaea9301dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd993d5-107e-4e4e-ac8c-ef18d816fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd993d5-107e-4e4e-ac8c-ef18d816fec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f801b839-aa7f-4f4c-83bb-02facdbc5419', 'volume_name': 'volume-f801b839-aa7f-4f4c-83bb-02facdbc5419', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f3223-c974-4ddc-9544-9a587981d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f3223-c974-4ddc-9544-9a587981d159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e4a822-0fe8-4958-bf80-2a9a067f7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:37 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume f801b839-aa7f-4f4c-83bb-02facdbc5419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f801b839-aa7f-4f4c-83bb-02facdbc5419', 'volume_size': 1} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:37 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:37 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069" returned: 0 in 1.103s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:37 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 1G Jul 07 22:54:37 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:37 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l Jul 07 22:54:37 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:37 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5c63aaab-8b60-4d02-a21c-c50005e4184a" returned: 0 in 0.698s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-5c63aaab-8b60-4d02-a21c-c50005e4184a" released by "delete_volume" :: held 1.831s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:37 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Created reservations ['00093b78-3bb3-403a-8f47-e3cd36988d22', '2f49de45-2acb-4fc7-9151-f2ee0d79fe59', '24e3e739-b2df-479b-afbb-57eb9862b62a', '15543a62-7a62-4c40-a720-232c4cbf6d41'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:38 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:38 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-3eb26d58-ea98-4b87-8df4-8f130c59994e-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-3eb26d58-ea98-4b87-8df4-8f130c59994e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:38 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l" returned: 1 in 0.985s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6_hh3yzu9l' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78710f5-2bd5-428c-8fc8-2b6104f8cabf]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "cinder-quobyte-3eb26d58-ea98-4b87-8df4-8f130c59994e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:38 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 1G" returned: 0 in 0.937s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd208641-afc9-481a-9a04-d9114f963069 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-3eb26d58-ea98-4b87-8df4-8f130c59994e" acquired by "delete_volume" :: waited 0.046s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:38 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd208641-afc9-481a-9a04-d9114f963069 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 Jul 07 22:54:38 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cad2d9-2c18-49dc-8e89-b4e66a829f9b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:38 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:38 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:38 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e Jul 07 22:54:38 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:38 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.773s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:38 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Deleted volume successfully. Jul 07 22:54:38 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c19ff90e-f3ec-4970-ab6b-d0fc4e9d1770 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-5c63aaab-8b60-4d02-a21c-c50005e4184a-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:39 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd208641-afc9-481a-9a04-d9114f963069 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:39 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 is being set with open permissions: ugo+rw Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:39 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:39 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 Jul 07 22:54:39 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:39 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e" returned: 0 in 0.867s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:39 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD Jul 07 22:54:39 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:39 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e Jul 07 22:54:39 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:39 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828" returned: 0 in 0.641s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:39 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info Jul 07 22:54:39 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 was raw, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:40 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-3eb26d58-ea98-4b87-8df4-8f130c59994e" returned: 0 in 0.726s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:40 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-quobyte-3eb26d58-ea98-4b87-8df4-8f130c59994e" released by "delete_volume" :: held 1.654s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Created reservations ['a5634786-22f5-4915-a2e5-16696556addc', '64f77bbf-8500-403b-a5c0-b123e127839e', 'eb638253-274a-4cda-8e66-70cb84d4bbd0', '7ac3d156-b2fd-4e58-b4ee-49644d6393f7'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:40 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:40 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info is being set with open permissions: ugo+rw Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:40 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info Jul 07 22:54:40 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dce56bb-b3f9-4066-aa95-ad70b5fe06a6__ssu6zdedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:54:40 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:40 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.680s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1G Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:40 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Deleted volume successfully. Jul 07 22:54:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c148638-8c48-441c-b5f9-271c45b34043 tempest-CreateVolumesFromImageTest-1622604046 None] Lock "cinder-3eb26d58-ea98-4b87-8df4-8f130c59994e-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:41 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.info" returned: 0 in 0.958s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.606s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834200210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15933f33-7f8f-4198-be9e-c3771db0b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:35Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume 15933f33-7f8f-4198-be9e-c3771db0b8d9 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:41 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:41 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 1073741824 Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 1G" returned: 0 in 0.776s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:41 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-289d7b18-2a55-421a-8dd2-eb403f9bb2f1 tempest-CinderUnicodeTest-233133527 None] Create snapshot completed successfully Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75bfe5-4fae-4ccc-9e1f-2b1ca6f6833b]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:41 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:41 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-97424346-b359-491b-a6b9-f65469d17828-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-97424346-b359-491b-a6b9-f65469d17828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-quobyte-97424346-b359-491b-a6b9-f65469d17828" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:42 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-97424346-b359-491b-a6b9-f65469d17828" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Deleting offline snapshot 97424346-b359-491b-a6b9-f65469d17828 of volume cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] snapshot_file for this snap is: volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 0 in 1.074s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[da980a28-0615-4f4d-b8af-fd0046dccd76]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:42 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 1073741824" returned: 0 in 1.255s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:42 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 Jul 07 22:54:42 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:42 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:42 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:43 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 Jul 07 22:54:43 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:43 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9" returned: 0 in 0.745s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.233s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35280057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f6af17-adfc-4d39-9842-674af8a7d543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:35Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume 27f6af17-adfc-4d39-9842-674af8a7d543 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:43 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:43 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 1073741824 Jul 07 22:54:43 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e319b0cd-fed6-40ae-bb24-87cb1a2622e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15933f33-7f8f-4198-be9e-c3771db0b8d9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f47c2-6aeb-40b1-a0f2-993124c5d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 (15933f33-7f8f-4198-be9e-c3771db0b8d9): created successfully Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43f47c2-6aeb-40b1-a0f2-993124c5d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:43 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (89c6ca51-3a1c-4b4c-b008-7f5b091fba10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828" returned: 0 in 1.006s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd208641-afc9-481a-9a04-d9114f963069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:54:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f5f2ab26-bb99-4b22-b9c5-6435b1f5206c tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629869a-dff4-4d77-8988-90ecbbf9e1d0]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:43 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 1 in 1.143s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Downloaded image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}])) to volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Temporary image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 for user 05785033a00a4794834abf0038f7a1d9 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:54:43 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Marking volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Copying metadata from image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 to 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Creating volume glance metadata for volume 2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 backed by image 9dce56bb-b3f9-4066-aa95-ad70b5fe06a6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7007fd35d02d5c6980d8b92d7016c935', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:54:44 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 Jul 07 22:54:44 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53569b83-c466-47bc-bdfe-3d98f2da7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0', 'volume_size': 1, 'image_id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7007fd35d02d5c6980d8b92d7016c935', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77aeeb4465c1498fad87e659b3419c79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a727637670f4fa3c039f888b4a260e5f2dc106007264456d3ce944785db416d002ea7242badec88d4ec653353849bee3eb360f9ceae50fc0c068d73fd06387a', 'id': '9dce56bb-b3f9-4066-aa95-ad70b5fe06a6', 'created_at': datetime.datetime(2026, 7, 7, 20, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 54, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dce56bb-b3f9-4066-aa95-ad70b5fe06a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1418c687-7a5d-4b5a-bc0b-757dcb492017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Volume volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 (2e300e9f-1de0-4dc0-a000-b89ee2b41ba0): created successfully Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1418c687-7a5d-4b5a-bc0b-757dcb492017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Flow 'volume_create_manager' (6a21392d-d243-4248-97c1-20f89c79a366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:44 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8379d532-6af1-445d-b2f5-782dfddcc054 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Created volume successfully. Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Acquiring lock "cinder-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "cinder-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Flow 'volume_create_manager' (66b6b801-4a66-45c7-965f-118403d7b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be8fe86-ae51-42d7-95ee-5fb55256f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be8fe86-ae51-42d7-95ee-5fb55256f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1580739586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e09c7a1-42b0-45b8-8edc-63f007515028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b01c78984d47c5a430f867bcc5db4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:44Z,use_quota=True,user_id='5033057d3ae440a294881fbe2f94188c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805dfad-8bfe-4c06-8d25-8d692cd2dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805dfad-8bfe-4c06-8d25-8d692cd2dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcac22a-bdb8-400a-87bd-7ac38808c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcac22a-bdb8-400a-87bd-7ac38808c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e09c7a1-42b0-45b8-8edc-63f007515028', 'volume_name': 'volume-6e09c7a1-42b0-45b8-8edc-63f007515028', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1729dc31-b9e5-41b8-97c3-b7e481ddde93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1729dc31-b9e5-41b8-97c3-b7e481ddde93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f75f2-70f5-45ee-bfe1-4a17e0c6f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:44 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Volume 6e09c7a1-42b0-45b8-8edc-63f007515028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e09c7a1-42b0-45b8-8edc-63f007515028', 'volume_size': 1} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Acquiring lock "cinder-quobyte-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "cinder-quobyte-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7d9f6-fb26-4271-ab51-fea268c9c1a9]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:44 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 1073741824" returned: 0 in 1.102s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:44 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069" returned: 0 in 0.965s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:44 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 Jul 07 22:54:44 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:44 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:44 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:44 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 Jul 07 22:54:44 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:45 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543" returned: 0 in 0.680s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.593s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856212181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233457c7-35dd-47bb-bb5f-2f6891f5b298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:36Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume 233457c7-35dd-47bb-bb5f-2f6891f5b298 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:45 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf165d3b-eabf-46ab-bddc-8997521c7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f6af17-adfc-4d39-9842-674af8a7d543', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:45 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 1073741824 Jul 07 22:54:45 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:45 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94722bac-1e50-42f7-a827-09afcc9ee68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828" returned: 0 in 0.781s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:45 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:45 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-27f6af17-adfc-4d39-9842-674af8a7d543 (27f6af17-adfc-4d39-9842-674af8a7d543): created successfully Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94722bac-1e50-42f7-a827-09afcc9ee68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:45 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828 Jul 07 22:54:45 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (50db2822-8570-4b37-a78f-61245c5e7534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 0 in 0.926s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-685e86cf-7027-4a4d-be73-900c6c5ce587 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:45 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:45 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:46 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069.97424346-b359-491b-a6b9-f65469d17828" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-97424346-b359-491b-a6b9-f65469d17828" released by "_delete_snapshot" :: held 3.622s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" released by "delete_snapshot" :: held 3.659s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:46 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 1 in 0.811s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Created reservations ['d29e5a24-0a94-41d8-809a-3168d4118957', 'f1b0e91c-156b-44bd-8367-6d3be2ca5dec', '52a8f73f-05dd-467f-982e-e2afc07e69a5', '6bfbc005-0850-4813-bae9-b5a3e19ebaa2'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:46 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0 Jul 07 22:54:46 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Delete snapshot completed successfully. Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-784d90ce-38e7-4e39-a1d1-ee532a77dee1 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-97424346-b359-491b-a6b9-f65469d17828-delete_snapshot" released by "delete_snapshot" :: held 3.860s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:46 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 1073741824" returned: 0 in 1.025s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:46 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 Jul 07 22:54:46 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-cd208641-afc9-481a-9a04-d9114f963069-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-cd208641-afc9-481a-9a04-d9114f963069-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c329fd1-f778-40d5-baee-03ec9e7926b3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:47 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" returned: 0 in 0.727s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "cinder-quobyte-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0" released by "delete_volume" :: held 2.540s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:47 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 Jul 07 22:54:47 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Created reservations ['31d6bba6-1192-4f09-9d70-6843093f8ab0', 'e718a68d-8ef2-4d4c-8ed3-47fc1b77b3e4', '40e19951-5803-43fc-9241-019f4299c08b', '08e1a34d-a41a-4399-9d33-06ea72cfabff'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:47 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298" returned: 0 in 0.736s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.793s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004205459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b146b55-bedf-46e5-9107-86e8c4613bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:36Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume 8b146b55-bedf-46e5-9107-86e8c4613bc8 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:47 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:47 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 1073741824 Jul 07 22:54:47 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953eb0f7-09d2-4058-8aa2-0f7c39daea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233457c7-35dd-47bb-bb5f-2f6891f5b298', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977c9c3-095c-4d60-96de-3c28405c9506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:47 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:47 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 (233457c7-35dd-47bb-bb5f-2f6891f5b298): created successfully Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977c9c3-095c-4d60-96de-3c28405c9506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:47 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (9d2075d8-6d43-485d-91a7-0880935cb7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:47 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7e7746c3-eadc-45f2-a3ee-1959987120e9 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:48 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069" returned: 0 in 1.065s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:48 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069 Jul 07 22:54:48 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:48 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.877s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Deleted volume successfully. Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0cc0b11d-c7db-47de-b1a1-0e0f6ebaf4e2 tempest-VolumeAndVolumeTypeFromImageTest-2122047475 None] Lock "cinder-2e300e9f-1de0-4dc0-a000-b89ee2b41ba0-delete_volume" released by "delete_volume" :: held 3.864s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:48 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 1073741824" returned: 0 in 1.205s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:48 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 Jul 07 22:54:48 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:49 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-cd208641-afc9-481a-9a04-d9114f963069" returned: 0 in 0.868s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-cd208641-afc9-481a-9a04-d9114f963069" released by "delete_volume" :: held 2.002s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Created reservations ['bf21fcdd-0433-494a-8d45-dcce5f17d357', '55c0136f-6d79-44b9-996c-2ff86838f02c', '3e66304e-bfe4-4821-82c7-0671c628d9ad', '2ea2ce9a-887c-4e7c-855c-06c687d5a96d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:49 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:49 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-5edce841-a5d6-49bc-987c-47e2317adbab-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:49 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.179s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553882128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801b839-aa7f-4f4c-83bb-02facdbc5419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ed94095e6144b5b94a3d84ccf6dbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:37Z,use_quota=True,user_id='183dde7f8a554d738866b51b544c804c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Creating volume f801b839-aa7f-4f4c-83bb-02facdbc5419 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:49 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e54578-47ba-4745-8ced-43b93bfddb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b146b55-bedf-46e5-9107-86e8c4613bc8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2922dd-4c82-41d5-ab7e-6105cf93e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-5edce841-a5d6-49bc-987c-47e2317adbab-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:49 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 1073741824 Jul 07 22:54:49 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 (8b146b55-bedf-46e5-9107-86e8c4613bc8): created successfully Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2922dd-4c82-41d5-ab7e-6105cf93e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (b0862676-f6c1-49e6-8897-2da286ccd96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2b34626e-68ef-4bc7-93cd-e83fd2a847c7 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "cinder-quobyte-5edce841-a5d6-49bc-987c-47e2317adbab" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-5edce841-a5d6-49bc-987c-47e2317adbab" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f08f01-d266-41ce-bd29-d181e4046252]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:49 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab Jul 07 22:54:49 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:50 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.128s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Deleted volume successfully. Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0b4258c9-9e9c-411f-b8f4-2269653bc493 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-cd208641-afc9-481a-9a04-d9114f963069-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:50 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 1073741824" returned: 0 in 1.353s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:50 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab" returned: 0 in 1.183s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:50 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 Jul 07 22:54:50 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:50 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab Jul 07 22:54:50 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:51 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419" returned: 0 in 0.764s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.973s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1580739586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e09c7a1-42b0-45b8-8edc-63f007515028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b01c78984d47c5a430f867bcc5db4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:44Z,use_quota=True,user_id='5033057d3ae440a294881fbe2f94188c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Creating volume 6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:51 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:51 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 1073741824 Jul 07 22:54:51 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:51 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e4a822-0fe8-4958-bf80-2a9a067f7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f801b839-aa7f-4f4c-83bb-02facdbc5419', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72699bb-6a8f-4df5-a4c7-ba1b2cbb44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5edce841-a5d6-49bc-987c-47e2317adbab" returned: 0 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:51 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Volume volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 (f801b839-aa7f-4f4c-83bb-02facdbc5419): created successfully Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72699bb-6a8f-4df5-a4c7-ba1b2cbb44d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Flow 'volume_create_manager' (de4e757e-0408-4511-99d0-e9bf616f1b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-quobyte-5edce841-a5d6-49bc-987c-47e2317adbab" released by "delete_volume" :: held 2.130s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:51 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ab72e8dc-fab0-4b6b-9eeb-010552e54c04 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created volume successfully. Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Created reservations ['a914e1fa-10f7-448a-8df5-2ca605a28bb7', '7307b352-823f-4de0-8824-578b724777e0', '0ca123bb-682b-40d3-beeb-3edeeb7db66a', 'b142cbdc-caef-4397-a943-b0cd29f189f1'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:52 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:52 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:52 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-f801b839-aa7f-4f4c-83bb-02facdbc5419-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 1073741824" returned: 0 in 1.145s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:52 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.855s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-f801b839-aa7f-4f4c-83bb-02facdbc5419-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Deleted volume successfully. Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0582b960-a06a-4237-a7a7-8121d6d66e26 tempest-CinderUnicodeTest-233133527 None] Lock "cinder-5edce841-a5d6-49bc-987c-47e2317adbab-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:52 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:54:52 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-f801b839-aa7f-4f4c-83bb-02facdbc5419" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f801b839-aa7f-4f4c-83bb-02facdbc5419" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d538f-72cd-42d5-a00d-643f48d27af5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:53 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 Jul 07 22:54:53 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:53 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 0.766s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f75f2-70f5-45ee-bfe1-4a17e0c6f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e09c7a1-42b0-45b8-8edc-63f007515028', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce71035-d6b2-410e-804f-36bc38889910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Volume volume-6e09c7a1-42b0-45b8-8edc-63f007515028 (6e09c7a1-42b0-45b8-8edc-63f007515028): created successfully Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce71035-d6b2-410e-804f-36bc38889910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Flow 'volume_create_manager' (66b6b801-4a66-45c7-965f-118403d7b707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:53 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f96c3c8e-c69f-4f59-a2ed-b77f071d89a4 tempest-VolumeDependencyTests-1575023179 None] Created volume successfully. Jul 07 22:54:54 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419" returned: 0 in 1.095s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:54 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419 Jul 07 22:54:54 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (47ba7a46-bbb8-4fe4-93dd-3572ceaf8b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bbb78d-d512-41a8-8c0e-09d6c838ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bbb78d-d512-41a8-8c0e-09d6c838ad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1440418389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37179dbe-0b5e-4834-91df-774a349d4456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:54Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932a2d8e-c1bb-445c-9f72-f9a844f0a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932a2d8e-c1bb-445c-9f72-f9a844f0a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8992a5d-d238-4781-b555-3eccaa44b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8992a5d-d238-4781-b555-3eccaa44b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37179dbe-0b5e-4834-91df-774a349d4456', 'volume_name': 'volume-37179dbe-0b5e-4834-91df-774a349d4456', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ea9653-a7d7-4d0a-85df-f28e7b4adad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ea9653-a7d7-4d0a-85df-f28e7b4adad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d36e5a-9cb8-441e-b26c-2b9f40902d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume 37179dbe-0b5e-4834-91df-774a349d4456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37179dbe-0b5e-4834-91df-774a349d4456', 'volume_size': 1} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1440418389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37179dbe-0b5e-4834-91df-774a349d4456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:54Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume 37179dbe-0b5e-4834-91df-774a349d4456 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:54 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:54 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 1073741824 Jul 07 22:54:54 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:54 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f801b839-aa7f-4f4c-83bb-02facdbc5419" returned: 0 in 0.839s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f801b839-aa7f-4f4c-83bb-02facdbc5419" released by "delete_volume" :: held 1.998s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['0c951f5f-6af0-4855-a97d-3ace9665df8a', 'fba391e1-3eed-40fb-b639-555630b49082', '2d1367f0-1df3-4be2-9d80-87c9dd723bbb', '636b221a-0120-4ce2-b310-bb3e733ed7ae'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:55 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:55 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:55 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 1073741824" returned: 0 in 1.074s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:55 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 Jul 07 22:54:55 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:55 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.810s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:54:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6e5834a-8f15-40a5-8a58-81adde1086af tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-f801b839-aa7f-4f4c-83bb-02facdbc5419-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-8b146b55-bedf-46e5-9107-86e8c4613bc8-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-8b146b55-bedf-46e5-9107-86e8c4613bc8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-8b146b55-bedf-46e5-9107-86e8c4613bc8" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-8b146b55-bedf-46e5-9107-86e8c4613bc8" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d6ee8b-0021-4149-b31c-c5e9c9364d61]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:56 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456" returned: 0 in 0.772s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.860s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d36e5a-9cb8-441e-b26c-2b9f40902d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37179dbe-0b5e-4834-91df-774a349d4456', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2f1956-2434-4a89-8ab5-e42bc2c4115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Creating offline snapshot 30261e5b-d8cb-4e7c-8845-e80b065d138a of volume 6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-37179dbe-0b5e-4834-91df-774a349d4456 (37179dbe-0b5e-4834-91df-774a349d4456): created successfully Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2f1956-2434-4a89-8ab5-e42bc2c4115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (47ba7a46-bbb8-4fe4-93dd-3572ceaf8b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3eb36d-7853-4593-85d9-63457a716c56]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bb1cb5f9-e508-4c28-93f0-b028282c9728 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:54:56 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 Jul 07 22:54:56 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:56 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:54:56 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:57 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:57 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8 Jul 07 22:54:57 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:57 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:57 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a 1G Jul 07 22:54:57 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-defd5dfe-d9df-4ebe-8906-2fb276b044a3 tempest-ProjectAdminTests-295852365 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:54:57 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-8b146b55-bedf-46e5-9107-86e8c4613bc8" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-8b146b55-bedf-46e5-9107-86e8c4613bc8" released by "delete_volume" :: held 1.719s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (3a1c99cd-4a05-44a9-bb2d-dd44380b6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4647c89-500c-49cb-bf7e-2f1d6b6029a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4647c89-500c-49cb-bf7e-2f1d6b6029a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720925746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2351c-22d2-4dda-9116-4866346f10a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:58Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b80b9d-00b5-4e10-888a-9ab018ec26f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b80b9d-00b5-4e10-888a-9ab018ec26f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b481c9-5d35-4cde-8fb9-595899543e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b481c9-5d35-4cde-8fb9-595899543e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad2351c-22d2-4dda-9116-4866346f10a8', 'volume_name': 'volume-aad2351c-22d2-4dda-9116-4866346f10a8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c4fea4-24b6-48ac-aa17-a6ae4aee132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c4fea4-24b6-48ac-aa17-a6ae4aee132a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1952c-9b07-4724-83ac-fc21a045c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume aad2351c-22d2-4dda-9116-4866346f10a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad2351c-22d2-4dda-9116-4866346f10a8', 'volume_size': 1} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['7b5fab58-b5ea-43fb-93a7-4fb7736c446f', '417a4d49-24c7-4d7d-a259-fad8203cbcf5', 'fd134476-ed0e-47aa-bf5e-fe4f300d8b8a', '3c1476d4-d088-4994-9335-d71b70f9d41c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:58 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a 1G" returned: 0 in 1.019s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e09c7a1-42b0-45b8-8edc-63f007515028 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:58 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:54:58 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:58 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e09c7a1-42b0-45b8-8edc-63f007515028 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:54:58 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-233457c7-35dd-47bb-bb5f-2f6891f5b298-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (f6941572-f413-4394-a8b3-5e138872ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c571171-69f1-4676-8edd-a7e8f065e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c571171-69f1-4676-8edd-a7e8f065e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863254941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91e2907-4a4b-4001-a399-86632543fa08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:58Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46e64a-baea-473c-9d42-77024e3a2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46e64a-baea-473c-9d42-77024e3a2049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18f4c7d-f310-4dc1-afbb-1a45823ea3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18f4c7d-f310-4dc1-afbb-1a45823ea3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91e2907-4a4b-4001-a399-86632543fa08', 'volume_name': 'volume-c91e2907-4a4b-4001-a399-86632543fa08', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92faa414-9a85-46ee-83ba-5c90e0751df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92faa414-9a85-46ee-83ba-5c90e0751df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919bf3e7-e726-4d79-a79d-83093928b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume c91e2907-4a4b-4001-a399-86632543fa08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91e2907-4a4b-4001-a399-86632543fa08', 'volume_size': 1} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-233457c7-35dd-47bb-bb5f-2f6891f5b298-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-233457c7-35dd-47bb-bb5f-2f6891f5b298" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-233457c7-35dd-47bb-bb5f-2f6891f5b298" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[886703cf-9789-49ab-8788-62bebd176731]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:59 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 Jul 07 22:54:59 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (c7a4a20e-ada5-4c54-a7e6-80ed9affa213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef42893-eb05-40c9-b06b-32680218e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e09c7a1-42b0-45b8-8edc-63f007515028 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 1.247s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:59 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a is being set with open permissions: ugo+rw Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef42893-eb05-40c9-b06b-32680218e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945230430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d25007-9bb3-4bb6-9310-ea7ece2e7b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:59Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff363d-c431-4caf-b4c5-512d2fad1804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff363d-c431-4caf-b4c5-512d2fad1804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:54:59 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892a2399-4348-41b3-a48b-3b2ec88270d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892a2399-4348-41b3-a48b-3b2ec88270d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d25007-9bb3-4bb6-9310-ea7ece2e7b78', 'volume_name': 'volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be566f25-528d-4724-bd7d-f822a52dd0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be566f25-528d-4724-bd7d-f822a52dd0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732567e9-246f-4ec1-a9b7-696cc999fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume 00d25007-9bb3-4bb6-9310-ea7ece2e7b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78', 'volume_size': 1} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.371s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49812d24-88a3-47d2-bf62-89e739c06c31 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-8b146b55-bedf-46e5-9107-86e8c4613bc8-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (1d63dd0b-70b8-4051-9773-fcb578d960b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1318a6-2e51-4304-b635-dec3941cf4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1318a6-2e51-4304-b635-dec3941cf4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747356585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b11d03-36cb-4a1e-a88c-5339730bbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:00Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffac71f-25cd-40f9-ac57-70080c0f8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffac71f-25cd-40f9-ac57-70080c0f8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e92115f-a334-41a1-ae8b-c85e60662655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e92115f-a334-41a1-ae8b-c85e60662655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b11d03-36cb-4a1e-a88c-5339730bbd6e', 'volume_name': 'volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f143b1a1-8801-4602-a6af-5ceabb31e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f143b1a1-8801-4602-a6af-5ceabb31e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1f7af0-2560-40e9-97b8-2cb45a44a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume f3b11d03-36cb-4a1e-a88c-5339730bbd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e', 'volume_size': 1} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:00 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298" returned: 0 in 1.340s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:00 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298 Jul 07 22:55:00 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (771d93e5-e7c3-4808-9583-aec0614a98e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a918d791-8d44-4df6-8ebd-7a2ad96c1654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a918d791-8d44-4df6-8ebd-7a2ad96c1654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785380515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69637f89-60b3-4f39-b90d-a08bdcfacd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:00Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021967d-74c3-4f1c-80c0-ebf4da3ba31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021967d-74c3-4f1c-80c0-ebf4da3ba31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40371ea-da9d-472d-acbd-204629dd702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40371ea-da9d-472d-acbd-204629dd702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69637f89-60b3-4f39-b90d-a08bdcfacd49', 'volume_name': 'volume-69637f89-60b3-4f39-b90d-a08bdcfacd49', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32129fee-f215-4cef-aa19-4c7e661778f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32129fee-f215-4cef-aa19-4c7e661778f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de1d66-a43e-47bd-bb11-e69d4bffeb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:00 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume 69637f89-60b3-4f39-b90d-a08bdcfacd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69637f89-60b3-4f39-b90d-a08bdcfacd49', 'volume_size': 1} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:00 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 0.979s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:00 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info Jul 07 22:55:00 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:01 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-233457c7-35dd-47bb-bb5f-2f6891f5b298" returned: 0 in 0.754s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-233457c7-35dd-47bb-bb5f-2f6891f5b298" released by "delete_volume" :: held 2.159s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['1bbcb9ad-a0fb-40be-bb3a-b104f5ecd62e', 'fa99d380-9653-4ae9-ae7f-6f0c858ac5ad', '46a7cc8e-5c25-4526-add3-20fee2e245d9', '4d3ff5aa-8ea7-441d-8640-fdc687a4ed52'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:01 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:01 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:01 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info" returned: 0 in 0.757s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:01 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info is being set with open permissions: ugo+rw Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:01 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info Jul 07 22:55:01 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:01 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:01 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-27f6af17-adfc-4d39-9842-674af8a7d543-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-27f6af17-adfc-4d39-9842-674af8a7d543-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d3068416-f6ca-49a8-aeae-cb0f7c9a0df8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-233457c7-35dd-47bb-bb5f-2f6891f5b298-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-27f6af17-adfc-4d39-9842-674af8a7d543" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-27f6af17-adfc-4d39-9842-674af8a7d543" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ed62b-df4f-48f7-be82-b8fc92787943]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:02 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.info" returned: 0 in 0.859s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.883s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.084s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720925746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2351c-22d2-4dda-9116-4866346f10a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:58Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume aad2351c-22d2-4dda-9116-4866346f10a8 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:02 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:02 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 1073741824 Jul 07 22:55:02 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ae5b9379-0f71-4dd9-b37b-e06a7c2a98db tempest-VolumeDependencyTests-1575023179 None] Create snapshot completed successfully Jul 07 22:55:02 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 Jul 07 22:55:02 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:03 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543" returned: 0 in 0.949s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:03 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543 Jul 07 22:55:03 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:03 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 1073741824" returned: 0 in 1.241s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:03 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 Jul 07 22:55:03 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:03 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-27f6af17-adfc-4d39-9842-674af8a7d543" returned: 0 in 0.858s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-27f6af17-adfc-4d39-9842-674af8a7d543" released by "delete_volume" :: held 1.877s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Flow 'volume_create_manager' (da39d23f-e697-4f48-bbcf-861cb0336ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8b128f-e042-4ad9-811e-a5a9400bcde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8b128f-e042-4ad9-811e-a5a9400bcde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1705992851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90e20b7-9699-4d7b-8f62-09bedf57111d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b01c78984d47c5a430f867bcc5db4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30261e5b-d8cb-4e7c-8845-e80b065d138a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:04Z,use_quota=True,user_id='5033057d3ae440a294881fbe2f94188c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbacefc-6b4a-439d-8dae-6bb17ad8da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbacefc-6b4a-439d-8dae-6bb17ad8da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d14d5e3-2021-43f9-98ab-6c8b2535d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d14d5e3-2021-43f9-98ab-6c8b2535d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a90e20b7-9699-4d7b-8f62-09bedf57111d', 'volume_name': 'volume-a90e20b7-9699-4d7b-8f62-09bedf57111d', 'volume_size': 1, 'snapshot_id': '30261e5b-d8cb-4e7c-8845-e80b065d138a'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211d2995-1c4d-4aa4-90c9-9ff98a55aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211d2995-1c4d-4aa4-90c9-9ff98a55aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fb8162-0f95-4743-a515-45482aae7530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Volume a90e20b7-9699-4d7b-8f62-09bedf57111d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a90e20b7-9699-4d7b-8f62-09bedf57111d', 'volume_size': 1, 'snapshot_id': '30261e5b-d8cb-4e7c-8845-e80b065d138a'} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['2e03c4d0-0c86-4642-a317-00f4685fb163', '0a05aed5-d2b7-4efc-b9a6-fac066e88384', '07bb3d2c-021f-4598-8b6c-99a0e8a1548e', 'b0235331-353a-4637-b73c-64fac04f6328'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:04 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:04 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-15933f33-7f8f-4198-be9e-c3771db0b8d9-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-15933f33-7f8f-4198-be9e-c3771db0b8d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-15933f33-7f8f-4198-be9e-c3771db0b8d9" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-15933f33-7f8f-4198-be9e-c3771db0b8d9" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:04 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8" returned: 0 in 1.009s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.788s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863254941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91e2907-4a4b-4001-a399-86632543fa08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:58Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume c91e2907-4a4b-4001-a399-86632543fa08 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:04 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5da339-c98a-4836-be87-59cfb81e66ba]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:04 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 1073741824 Jul 07 22:55:04 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1952c-9b07-4724-83ac-fc21a045c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad2351c-22d2-4dda-9116-4866346f10a8', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b489d5-9546-4750-9e28-6d273b114d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-aad2351c-22d2-4dda-9116-4866346f10a8 (aad2351c-22d2-4dda-9116-4866346f10a8): created successfully Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b489d5-9546-4750-9e28-6d273b114d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (3a1c99cd-4a05-44a9-bb2d-dd44380b6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a9092453-9f90-4de1-a108-75aba4efe115 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:55:04 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 Jul 07 22:55:04 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:05 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.233s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ae697984-1f1f-4967-a570-54af5be45ec8 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-27f6af17-adfc-4d39-9842-674af8a7d543-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:05 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 1073741824" returned: 0 in 1.268s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:05 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 Jul 07 22:55:05 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:05 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9" returned: 0 in 1.382s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:06 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9 Jul 07 22:55:06 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:06 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08" returned: 0 in 0.722s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.986s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945230430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d25007-9bb3-4bb6-9310-ea7ece2e7b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:59Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume 00d25007-9bb3-4bb6-9310-ea7ece2e7b78 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:06 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:06 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 1073741824 Jul 07 22:55:06 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919bf3e7-e726-4d79-a79d-83093928b695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91e2907-4a4b-4001-a399-86632543fa08', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff233324-b01f-4427-99f5-7f11cd7df6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-c91e2907-4a4b-4001-a399-86632543fa08 (c91e2907-4a4b-4001-a399-86632543fa08): created successfully Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff233324-b01f-4427-99f5-7f11cd7df6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (f6941572-f413-4394-a8b3-5e138872ed95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:06 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4552b926-1ab4-4ceb-b8e2-62611642d48b tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:55:06 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15933f33-7f8f-4198-be9e-c3771db0b8d9" returned: 0 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-15933f33-7f8f-4198-be9e-c3771db0b8d9" released by "delete_volume" :: held 2.305s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['36ea9dd6-1e9c-4338-b01e-e87a2b9b0f76', '126b50b9-1198-4628-8d28-6c3616d4b34d', 'e773af2e-2fd9-42d9-bf51-1de0356be8b1', '060646d5-ac8e-40be-a775-7b20c731b5fb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:07 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:07 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:07 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 1073741824" returned: 0 in 1.043s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:07 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 Jul 07 22:55:07 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:07 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.784s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3892c81f-08eb-426a-909a-a40ca0a80dfc tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-15933f33-7f8f-4198-be9e-c3771db0b8d9-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleting offline snapshot b8f9bba3-ce3a-4c59-badf-a46ec56fc32f of volume f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] snapshot_file for this snap is: volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c4940c-6f4e-4549-8196-ca5a8ce18ac9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:08 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f Jul 07 22:55:08 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:08 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.526s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747356585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b11d03-36cb-4a1e-a88c-5339730bbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:00Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume f3b11d03-36cb-4a1e-a88c-5339730bbd6e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:08 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732567e9-246f-4ec1-a9b7-696cc999fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036faef-516a-4268-bb03-74bf39b1f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e 1073741824 Jul 07 22:55:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 (00d25007-9bb3-4bb6-9310-ea7ece2e7b78): created successfully Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036faef-516a-4268-bb03-74bf39b1f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (c7a4a20e-ada5-4c54-a7e6-80ed9affa213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5c6d690e-85bb-46ae-beba-34fa7bbe3b9d tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:55:08 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" returned: 0 in 0.903s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0cc8851-3576-41e8-8d94-51f8c13fc220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd3c77-3ffa-4b9b-9680-edd7812ed814]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:09 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 Jul 07 22:55:09 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:09 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e 1073741824" returned: 0 in 0.977s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:09 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e Jul 07 22:55:09 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:09 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220" returned: 0 in 0.851s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:09 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f Jul 07 22:55:09 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:10 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.829s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785380515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69637f89-60b3-4f39-b90d-a08bdcfacd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e51a26e254e0cb8aca90974ad37d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:00Z,use_quota=True,user_id='a418b9888fcb4e568385fa3d9a1322c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Creating volume 69637f89-60b3-4f39-b90d-a08bdcfacd49 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:10 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1f7af0-2560-40e9-97b8-2cb45a44a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:10 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 1073741824 Jul 07 22:55:10 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ff3c01-1b07-4807-b215-00e76b5384d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:10 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e (f3b11d03-36cb-4a1e-a88c-5339730bbd6e): created successfully Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ff3c01-1b07-4807-b215-00e76b5384d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (1d63dd0b-70b8-4051-9773-fcb578d960b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c27a18f8-1581-4dd0-8723-6c03c3f76850 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:55:10 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:10 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f Jul 07 22:55:10 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:11 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 1073741824" returned: 0 in 1.073s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:11 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220.b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:11 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 Jul 07 22:55:11 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f" released by "_delete_snapshot" :: held 3.608s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" released by "delete_snapshot" :: held 3.635s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['ab005efb-c104-408e-a418-a9989dfbeffd', '5e7717db-b46d-40ea-bf4f-11753f7755d1', '46327a47-7e05-4e3d-a9fa-7f0d743d12e7', 'ecdbd209-2adb-43d1-86ab-ae2b5e3d0e5c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Delete snapshot completed successfully. Jul 07 22:55:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dc71b8e-d88e-4065-9e15-277b71735252 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-b8f9bba3-ce3a-4c59-badf-a46ec56fc32f-delete_snapshot" released by "delete_snapshot" :: held 3.804s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-f0cc8851-3576-41e8-8d94-51f8c13fc220-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-f0cc8851-3576-41e8-8d94-51f8c13fc220-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:12 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49" returned: 0 in 0.797s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.110s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a-a90e20b7-9699-4d7b-8f62-09bedf57111d" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738b9ec-b605-45d9-8d00-e63dc419afb9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a-a90e20b7-9699-4d7b-8f62-09bedf57111d" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Creating volume a90e20b7-9699-4d7b-8f62-09bedf57111d from snapshot 30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de1d66-a43e-47bd-bb11-e69d4bffeb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69637f89-60b3-4f39-b90d-a08bdcfacd49', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f47b448-cce6-4fa9-8b05-2146612c55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] snapshot: 30261e5b-d8cb-4e7c-8845-e80b065d138a, volume: a90e20b7-9699-4d7b-8f62-09bedf57111d, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:55:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Volume volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 (69637f89-60b3-4f39-b90d-a08bdcfacd49): created successfully Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f47b448-cce6-4fa9-8b05-2146612c55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Flow 'volume_create_manager' (771d93e5-e7c3-4808-9583-aec0614a98e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:12 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 Jul 07 22:55:12 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f89b8f8c-d58a-4133-83ca-ea9c38e20117 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created volume successfully. Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63b448-60aa-4df3-9c3a-7dd80d406baa]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:12 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:55:12 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-69637f89-60b3-4f39-b90d-a08bdcfacd49-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-69637f89-60b3-4f39-b90d-a08bdcfacd49-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-69637f89-60b3-4f39-b90d-a08bdcfacd49" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-69637f89-60b3-4f39-b90d-a08bdcfacd49" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[83304043-e7b6-4263-ab22-f07786f78a83]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:13 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220" returned: 0 in 0.917s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:13 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220 Jul 07 22:55:13 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:13 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 Jul 07 22:55:13 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:13 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 0.914s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e09c7a1-42b0-45b8-8edc-63f007515028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0a8e5-461e-477b-822c-260b2ea7532e]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:13 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:55:13 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:14 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f0cc8851-3576-41e8-8d94-51f8c13fc220" returned: 0 in 0.847s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-quobyte-f0cc8851-3576-41e8-8d94-51f8c13fc220" released by "delete_volume" :: held 1.860s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:14 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49" returned: 0 in 0.990s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:14 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49 Jul 07 22:55:14 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Created reservations ['8ce7b943-65a8-40ed-a6c6-158b2634c794', 'c33fc1d4-a53c-4adf-90d3-77ae94756f79', '6b221719-9f56-4192-8442-72f56b1012d7', 'e4f6623f-8b73-4609-9fdf-8bc65d4419e3'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:14 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:14 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:14 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 1.192s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:55:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:14 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d Jul 07 22:55:14 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:15 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-69637f89-60b3-4f39-b90d-a08bdcfacd49" returned: 0 in 1.134s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-69637f89-60b3-4f39-b90d-a08bdcfacd49" released by "delete_volume" :: held 2.185s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=197,cinder:SELECT=145,cinder:INSERT=53,cinder:DELETE=17 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=143,cinder:UPDATE=190,cinder:INSERT=45,cinder:DELETE=20 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:55:15 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.076s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Deleted volume successfully. Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-259b370f-e187-4184-9dd8-33db6ee77336 tempest-CreateVolumesFromSnapshotTest-470142550 None] Lock "cinder-f0cc8851-3576-41e8-8d94-51f8c13fc220-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['0b45b997-22f1-4ebf-8e6d-9b1913643c98', '1c70489f-6036-4e36-a4c6-da6c8a0792b0', 'e3dbbe2c-40ed-4adb-9113-2ded30ea5cff', 'a231ed46-32f5-4d0e-8f8e-5774eeea4bcf'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:15 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:15 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:15 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:15 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (40827252-d50d-4ce3-b99b-9e7f7401aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f9616a-08ee-442b-9eab-946765c69686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f9616a-08ee-442b-9eab-946765c69686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685849387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2224fd51-9039-4679-9e6c-2d1b1007d04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:16Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a49ac5-c065-4402-a280-abc6fb16a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a49ac5-c065-4402-a280-abc6fb16a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bfd0a6-7e56-400b-b86a-4f3701d76b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bfd0a6-7e56-400b-b86a-4f3701d76b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2224fd51-9039-4679-9e6c-2d1b1007d04b', 'volume_name': 'volume-2224fd51-9039-4679-9e6c-2d1b1007d04b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c138412-b1e9-4119-8479-da85b3bfd602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c138412-b1e9-4119-8479-da85b3bfd602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96491ba-5231-47f2-a9d2-b57816761db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:15 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Volume 2224fd51-9039-4679-9e6c-2d1b1007d04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2224fd51-9039-4679-9e6c-2d1b1007d04b', 'volume_size': 1} Jul 07 22:55:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:16 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-f3b11d03-36cb-4a1e-a88c-5339730bbd6e-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.265s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-f3b11d03-36cb-4a1e-a88c-5339730bbd6e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:16 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" acquired by "delete_volume" :: waited 0.066s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d333794f-dcca-4398-a9ae-b65a32aa6723]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:17 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e Jul 07 22:55:17 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:17 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 2.228s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-73d8ed44-11bf-46da-9a1d-1000b58f66b7 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-69637f89-60b3-4f39-b90d-a08bdcfacd49-delete_volume" released by "delete_volume" :: held 4.913s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:19 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" returned: 0 in 1.997s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:19 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e Jul 07 22:55:19 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:21 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" returned: 0 in 2.030s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-f3b11d03-36cb-4a1e-a88c-5339730bbd6e" released by "delete_volume" :: held 4.167s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:21 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d" returned: 0 in 6.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['c2c43d9a-21ba-48cb-a1d6-7a7fc02ba6ba', '07742d2e-5baf-4993-9f6d-14275d140100', '653d9309-c270-442d-b6f7-fad97f7cc2c5', '513f4708-df76-46cf-8ebb-500da3bd37df'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a848c-2307-45a4-813d-603341952c87]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:21 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:21 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:21 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:55:21 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:22 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.691s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aff41829-b21a-45b4-abb0-72f43ad95853 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-f3b11d03-36cb-4a1e-a88c-5339730bbd6e-delete_volume" released by "delete_volume" :: held 5.246s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:22 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 0.962s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:55:22 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Converted 1024.00 MB image at 151.66 MB/s Jul 07 22:55:22 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d is being set with open permissions: ugo+rw Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:22 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d Jul 07 22:55:22 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-00d25007-9bb3-4bb6-9310-ea7ece2e7b78-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-00d25007-9bb3-4bb6-9310-ea7ece2e7b78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ff06d-5923-4ed2-abdd-26ef09af5706]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:22 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 Jul 07 22:55:22 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:22 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" released by "_copy_volume_from_snapshot" :: held 10.646s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a-a90e20b7-9699-4d7b-8f62-09bedf57111d" released by "_create_volume_from_snapshot" :: held 10.698s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.732s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.167s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685849387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2224fd51-9039-4679-9e6c-2d1b1007d04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:16Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Creating volume 2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:22 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:23 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b 1073741824 Jul 07 22:55:23 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fb8162-0f95-4743-a515-45482aae7530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90e20b7-9699-4d7b-8f62-09bedf57111d', 'volume_size': 1, 'snapshot_id': '30261e5b-d8cb-4e7c-8845-e80b065d138a'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba46c78b-0efd-496a-959d-8eda7d7ce237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:23 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Volume volume-a90e20b7-9699-4d7b-8f62-09bedf57111d (a90e20b7-9699-4d7b-8f62-09bedf57111d): created successfully Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba46c78b-0efd-496a-959d-8eda7d7ce237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Flow 'volume_create_manager' (da39d23f-e697-4f48-bbcf-861cb0336ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:23 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0423abc1-3301-4608-a701-72bcb4163e92 tempest-VolumeDependencyTests-1575023179 None] Created volume successfully. Jul 07 22:55:23 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:23 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78 Jul 07 22:55:23 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-30261e5b-d8cb-4e7c-8845-e80b065d138a-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-30261e5b-d8cb-4e7c-8845-e80b065d138a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Deleting offline snapshot 30261e5b-d8cb-4e7c-8845-e80b065d138a of volume 6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] snapshot_file for this snap is: volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:55:24 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b 1073741824" returned: 0 in 1.060s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e35ffe-694a-4321-bb17-cd6058967990]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:24 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b Jul 07 22:55:24 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:24 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" returned: 0 in 0.813s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-00d25007-9bb3-4bb6-9310-ea7ece2e7b78" released by "delete_volume" :: held 1.712s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:24 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:55:24 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['f6586294-4340-48d8-b8e7-1bf9bf378719', '123ece8b-681c-4c3f-a133-675c0d39f3a3', 'a03f7981-f081-421d-96cf-c4948b553531', '97306389-0a15-49fd-9975-553adc7621ca'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:24 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:24 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-c91e2907-4a4b-4001-a399-86632543fa08-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-c91e2907-4a4b-4001-a399-86632543fa08-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-c91e2907-4a4b-4001-a399-86632543fa08" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-c91e2907-4a4b-4001-a399-86632543fa08" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[547f9b2e-e5dd-425d-8e4e-699aea84144f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:24 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96491ba-5231-47f2-a9d2-b57816761db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2224fd51-9039-4679-9e6c-2d1b1007d04b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5abb20-0140-44b2-84d8-d777739d05e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:24 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Volume volume-2224fd51-9039-4679-9e6c-2d1b1007d04b (2224fd51-9039-4679-9e6c-2d1b1007d04b): created successfully Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5abb20-0140-44b2-84d8-d777739d05e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (40827252-d50d-4ce3-b99b-9e7f7401aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:24 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 0.899s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e09c7a1-42b0-45b8-8edc-63f007515028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ee5700b3-1f08-471a-b060-d616c7153d06 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78bb59-b441-4d19-9beb-054c3e6a3af9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:25 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 Jul 07 22:55:25 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:25 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:55:25 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:25 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.904s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-0307107f-924c-470a-aea5-dbbc5b2cf2ef tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-00d25007-9bb3-4bb6-9310-ea7ece2e7b78-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:25 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08" returned: 0 in 0.948s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:25 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08 Jul 07 22:55:25 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:25 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 0.959s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:25 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:55:25 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 of volume 2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f855e943-f4e5-4599-bbad-17dd697de1ce]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:26 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b Jul 07 22:55:26 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:26 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c91e2907-4a4b-4001-a399-86632543fa08" returned: 0 in 0.728s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-c91e2907-4a4b-4001-a399-86632543fa08" released by "delete_volume" :: held 1.733s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['e1e94417-8feb-401c-bcfb-fa0392f5c65b', '1ce8f4fe-192a-40cd-b624-d33fe3e62da2', '3dbf0581-9192-4423-9255-aab0d49b0181', '31ffacd8-9c23-4147-84d0-8c3145ddabba'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:26 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:26 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:26 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 0.880s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:26 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a Jul 07 22:55:26 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:26 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:26 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 1G Jul 07 22:55:26 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-aad2351c-22d2-4dda-9116-4866346f10a8-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-aad2351c-22d2-4dda-9116-4866346f10a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-aad2351c-22d2-4dda-9116-4866346f10a8" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-aad2351c-22d2-4dda-9116-4866346f10a8" acquired by "delete_volume" :: waited 0.042s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d03452-9d04-4110-84f6-a0637e548aec]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:27 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 Jul 07 22:55:27 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:27 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.870s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f28d70b9-5188-4fbc-a2cb-ca39cb02bf3f tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-c91e2907-4a4b-4001-a399-86632543fa08-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:27 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028.30261e5b-d8cb-4e7c-8845-e80b065d138a" returned: 0 in 1.050s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:27 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 1G" returned: 0 in 1.034s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2224fd51-9039-4679-9e6c-2d1b1007d04b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-30261e5b-d8cb-4e7c-8845-e80b065d138a" released by "_delete_snapshot" :: held 3.932s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:27 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" released by "delete_snapshot" :: held 3.966s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:27 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2224fd51-9039-4679-9e6c-2d1b1007d04b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 Jul 07 22:55:27 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Created reservations ['4d4668d0-307a-49d8-9237-e111971c5c7c', 'ad3b71af-25c4-4a53-9903-ffbeff864a56', '1babca37-9bb3-450d-a1f5-1065013dd693', '46b65de4-0b54-4b65-b9f7-7b5dcdb96580'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:28 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Delete snapshot completed successfully. Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-46690d74-b100-4aa4-80df-dabea3e1e576 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-30261e5b-d8cb-4e7c-8845-e80b065d138a-delete_snapshot" released by "delete_snapshot" :: held 4.146s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:28 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8" returned: 0 in 1.059s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:28 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8 Jul 07 22:55:28 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-6e09c7a1-42b0-45b8-8edc-63f007515028-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-6e09c7a1-42b0-45b8-8edc-63f007515028-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b986839f-0da0-41b2-8f7f-c8792a1e4e87]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:28 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:55:28 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:28 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2224fd51-9039-4679-9e6c-2d1b1007d04b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" returned: 0 in 1.050s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:28 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 is being set with open permissions: ugo+rw Jul 07 22:55:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:29 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 Jul 07 22:55:29 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:29 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-aad2351c-22d2-4dda-9116-4866346f10a8" returned: 0 in 0.880s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-aad2351c-22d2-4dda-9116-4866346f10a8" released by "delete_volume" :: held 2.012s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['a22f26c6-15d1-4983-bf4b-5c0d5a075c0f', '422813f0-0a57-4d62-a3ce-673367473685', 'd055e2fc-0ddc-4213-9b00-3dc4c8178e37', '88b818a4-5fb2-4014-a1c5-4d19991d7dc3'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:29 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:29 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:29 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 1.091s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:29 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028 Jul 07 22:55:29 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:29 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" returned: 0 in 0.808s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:29 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info Jul 07 22:55:29 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:30 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.726s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:30 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-ff0b13ec-9652-4cfc-ad9d-10852b7084cf tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-aad2351c-22d2-4dda-9116-4866346f10a8-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:30 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6e09c7a1-42b0-45b8-8edc-63f007515028" returned: 0 in 0.790s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-6e09c7a1-42b0-45b8-8edc-63f007515028" released by "delete_volume" :: held 1.955s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-37179dbe-0b5e-4834-91df-774a349d4456-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-37179dbe-0b5e-4834-91df-774a349d4456-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Created reservations ['b4933e60-0a3e-4f79-bdc1-33b977539680', 'ecc4e3d0-50a6-4855-91fb-1c7fe5f85a8c', '3fdd9261-60a3-49e1-b370-0e53826fd409', '08e8dc4f-0b47-4ecb-aa4e-e241459ed74b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "cinder-quobyte-37179dbe-0b5e-4834-91df-774a349d4456" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-37179dbe-0b5e-4834-91df-774a349d4456" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:30 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe3509-f79b-4c62-9bfa-8b4af9ff52fd]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info" returned: 0 in 0.837s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:30 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info is being set with open permissions: ugo+rw Jul 07 22:55:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:30 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:30 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:30 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info Jul 07 22:55:30 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:30 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 Jul 07 22:55:30 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:31 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.721s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Deleted volume successfully. Jul 07 22:55:31 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-11b34d1c-a08a-4177-b1ff-157a06a57679 tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-6e09c7a1-42b0-45b8-8edc-63f007515028-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.info" returned: 0 in 0.743s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.412s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a3d11a72-dbe0-49f2-a913-b134a1fb6be3 tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:55:31 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456" returned: 0 in 0.888s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:31 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456 Jul 07 22:55:31 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-a90e20b7-9699-4d7b-8f62-09bedf57111d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-a90e20b7-9699-4d7b-8f62-09bedf57111d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf48953-7f6c-4c7f-8cef-0faba2f46bd3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:31 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d Jul 07 22:55:31 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:32 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-37179dbe-0b5e-4834-91df-774a349d4456" returned: 0 in 0.748s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-quobyte-37179dbe-0b5e-4834-91df-774a349d4456" released by "delete_volume" :: held 1.715s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Created reservations ['bc15f773-3041-43c5-a66f-dba6f8c3ad00', 'c6ae16e8-4b50-47da-99a7-b1bca3c479b6', '2e7394f0-8f61-483e-ad45-ded98639e483', 'bd2c43b3-5452-4dc2-814e-6e38e89aaab2'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 of volume 2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:55:32 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:32 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fb803b-6476-4197-b069-07b36be719b4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:32 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 Jul 07 22:55:32 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:32 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:32 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d Jul 07 22:55:32 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:33 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.844s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:33 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Deleted volume successfully. Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ad68ad-0207-4aca-8a51-89d36d482c46 tempest-CreateVolumesFromSourceVolumeTest-112459867 None] Lock "cinder-37179dbe-0b5e-4834-91df-774a349d4456-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:33 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" returned: 0 in 1.009s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2224fd51-9039-4679-9e6c-2d1b1007d04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f551ae0-2584-4451-9824-f1f5abb28d7c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:33 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a90e20b7-9699-4d7b-8f62-09bedf57111d" returned: 0 in 0.922s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-quobyte-a90e20b7-9699-4d7b-8f62-09bedf57111d" released by "delete_volume" :: held 1.871s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Created reservations ['6874635f-c9b2-42e7-a933-ce7aadeb5edb', '12ec8515-0a83-48f7-93ce-3ca417325546', 'dcbcbcba-3281-433e-88a1-af851b005882', 'd277d954-6c42-4d9c-8f16-3d40cf37d1c4'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:33 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b Jul 07 22:55:33 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:33 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:33 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:34 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b" returned: 0 in 1.259s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:34 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 Jul 07 22:55:34 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:34 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 1.096s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:34 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Deleted volume successfully. Jul 07 22:55:35 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7a27e3ca-52d4-4511-9e12-159d1fb6b20f tempest-VolumeDependencyTests-1575023179 None] Lock "cinder-a90e20b7-9699-4d7b-8f62-09bedf57111d-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:35 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" returned: 0 in 0.985s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:35 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9 Jul 07 22:55:35 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:36 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b.8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" returned: 0 in 0.699s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9" released by "_delete_snapshot" :: held 4.143s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" released by "delete_snapshot" :: held 4.197s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:36 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Created reservations ['20fc91c4-a9be-4d32-b3e7-b38bc8dc350e', '02c6ffd3-c221-4a53-b478-d655f8b0c3cd', 'ea74b526-5a1e-402e-b7dd-c9757a1d88e5', '156d5219-4eb4-4758-a4ca-41cb024194b9'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:55:36 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-970158d9-0618-44f6-b44d-f41f81a53c89 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-8fdfe244-47a4-4ffb-8c98-f0a9500b99c9-delete_snapshot" released by "delete_snapshot" :: held 4.425s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-2224fd51-9039-4679-9e6c-2d1b1007d04b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-2224fd51-9039-4679-9e6c-2d1b1007d04b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:38 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb64155-3637-4c6f-a1f7-2172bfff7122]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:38 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b Jul 07 22:55:38 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:38 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b" returned: 0 in 0.939s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:38 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b Jul 07 22:55:38 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:39 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2224fd51-9039-4679-9e6c-2d1b1007d04b" returned: 0 in 0.688s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2224fd51-9039-4679-9e6c-2d1b1007d04b" released by "delete_volume" :: held 1.717s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Created reservations ['012e0235-148d-4918-af17-835c257deeab', '60e7e78a-fc4c-42df-b740-52f975530acf', '62f06f1c-b5a0-41a8-a7e5-c396a61b44bd', '605f034a-b0f6-4692-b0ea-a73059f7dc91'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:39 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:39 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:40 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (2df94f94-b8a3-4c53-97ce-c24c24df440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ae418b-8e2e-446b-8bc2-cba9ec33a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.999s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:40 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ae418b-8e2e-446b-8bc2-cba9ec33a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263252749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2988eef8-ab28-422e-b605-ef0e6ec681e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:41Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc3c897-03f3-4d83-a560-67e585c83764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc3c897-03f3-4d83-a560-67e585c83764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2991a298-118a-4615-9966-fc6d9fd106fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2991a298-118a-4615-9966-fc6d9fd106fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2988eef8-ab28-422e-b605-ef0e6ec681e1', 'volume_name': 'volume-2988eef8-ab28-422e-b605-ef0e6ec681e1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21497521-9379-469d-bb7a-03a12ffbdde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21497521-9379-469d-bb7a-03a12ffbdde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742f80df-9d56-497a-84a9-3ec3da00c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:40 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Volume 2988eef8-ab28-422e-b605-ef0e6ec681e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2988eef8-ab28-422e-b605-ef0e6ec681e1', 'volume_size': 1} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263252749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2988eef8-ab28-422e-b605-ef0e6ec681e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:41Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Creating volume 2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:40 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7dfb1277-6c87-410b-a5b7-ef39f7143343 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-2224fd51-9039-4679-9e6c-2d1b1007d04b-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:40 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 1073741824 Jul 07 22:55:40 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Flow 'volume_create_manager' (df6fe8a7-5721-49bc-9e9e-8b09aa39d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001e4c92-ce5a-4aa5-97ed-af65170f3e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001e4c92-ce5a-4aa5-97ed-af65170f3e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee64f9-bd29-4ab0-bcb8-4d931eea0e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11aa9b17290b4e0b9dc5d08025cbcf0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:42Z,use_quota=True,user_id='d2280c5896214ef4af35fd38a8eb7914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f6877a-afea-4a6e-a121-64b8478dc063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f6877a-afea-4a6e-a121-64b8478dc063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeaf980-cfb3-408e-827b-f4938ac0286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG cinder.image.glance [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Creating Keystone auth plugin from conf {{(pid=88087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:55:41 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 1073741824" returned: 0 in 0.996s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:41 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 Jul 07 22:55:41 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeaf980-cfb3-408e-827b-f4938ac0286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15ee64f9-bd29-4ab0-bcb8-4d931eea0e89', 'volume_name': 'volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89', 'volume_size': 1, 'image_id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81a93ad54e6ef1e52cafa9e4ddb746ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '11aa9b17290b4e0b9dc5d08025cbcf0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11e2ea705581d40e84bff506d1abba57a061fb9964548575d1169f4d4e0c6dc695df2920a113b9ef43246663bba540aaa86a1da2dad35b1429af5b28941eea67', 'id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df266d7-e5b8-421f-ba71-c6332f852ba2/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250b1aa3-7097-454b-bb7d-72daf5062114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250b1aa3-7097-454b-bb7d-72daf5062114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637b6b7d-f133-4c0c-8f79-c39152ddc9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89', 'volume_size': 1, 'image_id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81a93ad54e6ef1e52cafa9e4ddb746ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '11aa9b17290b4e0b9dc5d08025cbcf0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11e2ea705581d40e84bff506d1abba57a061fb9964548575d1169f4d4e0c6dc695df2920a113b9ef43246663bba540aaa86a1da2dad35b1429af5b28941eea67', 'id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df266d7-e5b8-421f-ba71-c6332f852ba2/file', 'properties': {}}, 'image_service': } Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Trying to clone 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 from image 0df266d7-e5b8-421f-ba71-c6332f852ba2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}]). {{(pid=88087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:55:42 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9bb574-dbeb-49b7-96f7-f7ab6a6e4801]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:42 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:42 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:42 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1" returned: 0 in 0.742s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742f80df-9d56-497a-84a9-3ec3da00c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2988eef8-ab28-422e-b605-ef0e6ec681e1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b2390-23ad-4a0a-902c-8dc785826881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:42 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Volume volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 (2988eef8-ab28-422e-b605-ef0e6ec681e1): created successfully Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b2390-23ad-4a0a-902c-8dc785826881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:42 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (2df94f94-b8a3-4c53-97ce-c24c24df440e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:42 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-844728dd-b20a-4ff7-abdf-da6bf326ce0e tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:55:43 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:43 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:43 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:43 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 1 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Temporary image 0df266d7-e5b8-421f-ba71-c6332f852ba2 is fetched for user d2280c5896214ef4af35fd38a8eb7914. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f35fe-da01-4575-87be-1beb82121cae]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:43 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:43 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot eb539a46-3db4-4163-8d85-d14a42465334 of volume 2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[901add6d-659f-48b0-82b6-bd8d509458c3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:44 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 Jul 07 22:55:44 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:44 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 0 in 0.820s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:44 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:44 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:45 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1" returned: 0 in 0.932s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:45 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 1G Jul 07 22:55:45 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:45 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 1 in 0.791s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:55:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:46 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 1G" returned: 0 in 0.989s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:46 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 Jul 07 22:55:46 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:46 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334" returned: 0 in 0.696s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:46 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 is being set with open permissions: ugo+rw Jul 07 22:55:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:46 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 Jul 07 22:55:46 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:47 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334" returned: 0 in 0.653s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:47 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info Jul 07 22:55:47 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:48 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info" returned: 0 in 0.703s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:48 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info is being set with open permissions: ugo+rw Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:48 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info Jul 07 22:55:48 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Flow 'volume_create_manager' (254e1cfb-022d-408e-82e3-c8cef9fa4ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641e408f-ee60-4fc5-8b8d-b8ae0995d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641e408f-ee60-4fc5-8b8d-b8ae0995d307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736592044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f402ec8-269e-4cde-828a-e77d75cb64f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee55852affb47ca88d7f10e64d21499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:48Z,use_quota=True,user_id='9be154ca403740e59996ed277e40e8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd354775-847b-4a14-976d-1b3c7b7b42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd354775-847b-4a14-976d-1b3c7b7b42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c29f96-29c9-4265-92e2-6a376a05b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c29f96-29c9-4265-92e2-6a376a05b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f402ec8-269e-4cde-828a-e77d75cb64f1', 'volume_name': 'volume-9f402ec8-269e-4cde-828a-e77d75cb64f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0f9946-b086-436c-a2d3-95ef736e75cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0f9946-b086-436c-a2d3-95ef736e75cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a49c90-3022-4cc8-9268-bed440e0b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:48 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Volume 9f402ec8-269e-4cde-828a-e77d75cb64f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f402ec8-269e-4cde-828a-e77d75cb64f1', 'volume_size': 1} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:48 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.info" returned: 0 in 0.716s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.368s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee64f9-bd29-4ab0-bcb8-4d931eea0e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11aa9b17290b4e0b9dc5d08025cbcf0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:42Z,use_quota=True,user_id='d2280c5896214ef4af35fd38a8eb7914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Creating volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:48 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:48 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1073741824 Jul 07 22:55:48 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-ece359f7-f806-47e9-b762-d1f1ad370d1a tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-eb539a46-3db4-4163-8d85-d14a42465334-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-eb539a46-3db4-4163-8d85-d14a42465334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-eb539a46-3db4-4163-8d85-d14a42465334" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-eb539a46-3db4-4163-8d85-d14a42465334" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot eb539a46-3db4-4163-8d85-d14a42465334 of volume 2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16e25c-1097-46f7-8fee-3eb828168175]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:49 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 Jul 07 22:55:49 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:49 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1073741824" returned: 0 in 0.892s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:49 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:49 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:50 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334" returned: 0 in 0.821s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2988eef8-ab28-422e-b605-ef0e6ec681e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8098c1c4-5318-4205-a85e-442f5c8045fe]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:50 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 Jul 07 22:55:50 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:50 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 0 in 0.693s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736592044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f402ec8-269e-4cde-828a-e77d75cb64f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee55852affb47ca88d7f10e64d21499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:48Z,use_quota=True,user_id='9be154ca403740e59996ed277e40e8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Creating volume 9f402ec8-269e-4cde-828a-e77d75cb64f1 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:50 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:50 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 1073741824 Jul 07 22:55:50 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Attempting download of 0df266d7-e5b8-421f-ba71-c6332f852ba2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}])) to volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[685065be-4e44-4eb5-919c-f19239a1f6cb]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:50 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd Jul 07 22:55:50 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:51 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:51 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 Jul 07 22:55:51 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:51 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd" returned: 0 in 0.805s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:51 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 1073741824" returned: 0 in 0.973s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:51 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 Jul 07 22:55:51 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:51 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd Jul 07 22:55:51 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:51 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334" returned: 0 in 0.893s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:51 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334 Jul 07 22:55:51 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:52 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd" returned: 1 in 0.894s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df266d7-e5b8-421f-ba71-c6332f852ba2_rh81ggrd' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffde70-d547-4809-9f82-552acc456772]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:52 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1" returned: 0 in 0.837s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a49c90-3022-4cc8-9268-bed440e0b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f402ec8-269e-4cde-828a-e77d75cb64f1', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89b35af-8092-4941-ba16-3c7787cb62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:52 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Volume volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 (9f402ec8-269e-4cde-828a-e77d75cb64f1): created successfully Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89b35af-8092-4941-ba16-3c7787cb62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Flow 'volume_create_manager' (254e1cfb-022d-408e-82e3-c8cef9fa4ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-88ce2cee-51e5-42ec-8ecd-20ec5d3d50e3 tempest-ProjectReaderTests-698613123 None] Created volume successfully. Jul 07 22:55:52 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:52 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:52 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1.eb539a46-3db4-4163-8d85-d14a42465334" returned: 0 in 0.671s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-eb539a46-3db4-4163-8d85-d14a42465334" released by "_delete_snapshot" :: held 3.310s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" released by "delete_snapshot" :: held 3.342s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Created reservations ['de1502ae-0b1c-4ea0-90b9-d446ea44cffb', '0ed9d72d-1f91-428d-a262-71ddd6170de9', '54293103-56ab-4e76-b209-383fa08d1c0f', '118735e0-0319-4cf8-8801-7be9de762cc8'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c85c40d7-a5f3-4425-b631-d919e4ea3b03 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-eb539a46-3db4-4163-8d85-d14a42465334-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Acquiring lock "cinder-9f402ec8-269e-4cde-828a-e77d75cb64f1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "cinder-9f402ec8-269e-4cde-828a-e77d75cb64f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Acquiring lock "cinder-quobyte-9f402ec8-269e-4cde-828a-e77d75cb64f1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "cinder-quobyte-9f402ec8-269e-4cde-828a-e77d75cb64f1" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648cc9b-1457-4232-8a9e-9851da4f1bdb]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:53 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 Jul 07 22:55:53 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:53 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 0 in 0.923s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:53 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD Jul 07 22:55:53 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-2988eef8-ab28-422e-b605-ef0e6ec681e1-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-2988eef8-ab28-422e-b605-ef0e6ec681e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d1a69-8036-4a0d-bad9-91cbc03d49e2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:53 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:53 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1 Jul 07 22:55:53 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:53 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 Jul 07 22:55:53 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:54 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD" returned: 1 in 0.816s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] 0df266d7-e5b8-421f-ba71-c6332f852ba2 was raw, converting to raw {{(pid=88087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:54 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:54 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:54 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-9f402ec8-269e-4cde-828a-e77d75cb64f1" returned: 0 in 0.708s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "cinder-quobyte-9f402ec8-269e-4cde-828a-e77d75cb64f1" released by "delete_volume" :: held 1.612s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Created reservations ['3425583f-0b89-4a59-a24e-a3f20b0fc607', 'ca01b5e8-8556-4195-a954-11f6d8a2be77', '2c6fa7f6-3704-4331-a7e4-76230101de3b', '02a5a0da-1e05-44df-8ae0-49de68c187c0'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:54 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1" returned: 0 in 0.832s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:54 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1 Jul 07 22:55:54 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:54 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:54 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:54 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 0 in 0.838s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0df266d7-e5b8-421f-ba71-c6332f852ba2_3511ilr6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:55:54 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:55:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:54 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1G Jul 07 22:55:54 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:55 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2988eef8-ab28-422e-b605-ef0e6ec681e1" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-2988eef8-ab28-422e-b605-ef0e6ec681e1" released by "delete_volume" :: held 1.639s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:55 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.702s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:55 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Deleted volume successfully. Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-db6f2d89-2838-4ef2-b17f-3d555a80de28 tempest-ProjectReaderTests-698613123 None] Lock "cinder-9f402ec8-269e-4cde-828a-e77d75cb64f1-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Created reservations ['8b640db2-0a23-449b-861e-84b146abf083', 'f0c1fc80-7133-4094-971e-5670fa790910', 'eb47ef3d-a219-4919-9064-6e1fcc7f9690', '952c579e-58ae-4e2a-90e2-3526edfd25ad'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:55 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:55:55 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:55 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 1G" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Flow 'volume_create_manager' (c246d9f5-64cc-412d-bbef-6d0e2fac4027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b57e55-6c5a-4367-9a87-cb30293270b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b398d-fa9d-4f20-860d-8cf77ee8f0ae]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b57e55-6c5a-4367-9a87-cb30293270b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462727692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a108878e-2385-43cb-8291-d9131fa98a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee55852affb47ca88d7f10e64d21499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:56Z,use_quota=True,user_id='9be154ca403740e59996ed277e40e8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26610436-ea0f-4b91-af74-8172ca8464ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26610436-ea0f-4b91-af74-8172ca8464ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e9c9e4-a056-4db3-8003-6eefd1eef3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e9c9e4-a056-4db3-8003-6eefd1eef3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a108878e-2385-43cb-8291-d9131fa98a85', 'volume_name': 'volume-a108878e-2385-43cb-8291-d9131fa98a85', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a83db-b05f-413c-8cf9-1a8015c81a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a83db-b05f-413c-8cf9-1a8015c81a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc71b955-f5e9-4877-87f6-f292b8b0c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:55 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Volume a108878e-2385-43cb-8291-d9131fa98a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a108878e-2385-43cb-8291-d9131fa98a85', 'volume_size': 1} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462727692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a108878e-2385-43cb-8291-d9131fa98a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee55852affb47ca88d7f10e64d21499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:56Z,use_quota=True,user_id='9be154ca403740e59996ed277e40e8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Creating volume a108878e-2385-43cb-8291-d9131fa98a85 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:55 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:55 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 1073741824 Jul 07 22:55:55 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:55 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:55 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:56 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.848s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (73728372-5c40-4f1d-a2eb-ddce68d5fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6538b8-0d76-49c5-b99f-5443ef52ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7e11fa7e-734a-4ea9-b9c3-3cd20712d871 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-2988eef8-ab28-422e-b605-ef0e6ec681e1-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6538b8-0d76-49c5-b99f-5443ef52ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145869683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3207c12-a417-41c9-a22c-e20136a276b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:56Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d269d1f-a603-49c8-90c8-3c0f9d689283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d269d1f-a603-49c8-90c8-3c0f9d689283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7421b4-6463-4258-895d-36908f6ef247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7421b4-6463-4258-895d-36908f6ef247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3207c12-a417-41c9-a22c-e20136a276b9', 'volume_name': 'volume-d3207c12-a417-41c9-a22c-e20136a276b9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d39911-5c6b-4ecc-80d3-bba6147800cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d39911-5c6b-4ecc-80d3-bba6147800cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9d7c16-02b9-497a-8f1d-784f484dcdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Volume d3207c12-a417-41c9-a22c-e20136a276b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3207c12-a417-41c9-a22c-e20136a276b9', 'volume_size': 1} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:56 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 0 in 1.051s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:56 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 1073741824" returned: 0 in 1.076s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:56 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:56 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:57 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 Jul 07 22:55:57 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:57 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 1 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Downloaded image 0df266d7-e5b8-421f-ba71-c6332f852ba2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}])) to volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 successfully. {{(pid=88087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Temporary image 0df266d7-e5b8-421f-ba71-c6332f852ba2 for user d2280c5896214ef4af35fd38a8eb7914 is deleted. {{(pid=88087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.volume_utils [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Marking volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 as bootable. {{(pid=88087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Copying metadata from image 0df266d7-e5b8-421f-ba71-c6332f852ba2 to 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89. {{(pid=88087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Creating volume glance metadata for volume 15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 backed by image 0df266d7-e5b8-421f-ba71-c6332f852ba2 with: {'image_id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '81a93ad54e6ef1e52cafa9e4ddb746ee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:55:57 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85" returned: 0 in 0.690s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145869683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3207c12-a417-41c9-a22c-e20136a276b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:56Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Creating volume d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:55:57 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:57 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 1073741824 Jul 07 22:55:57 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc71b955-f5e9-4877-87f6-f292b8b0c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a108878e-2385-43cb-8291-d9131fa98a85', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b6778e-d732-45bf-8f82-78ce4b7943e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Volume volume-a108878e-2385-43cb-8291-d9131fa98a85 (a108878e-2385-43cb-8291-d9131fa98a85): created successfully Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b6778e-d732-45bf-8f82-78ce4b7943e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Flow 'volume_create_manager' (c246d9f5-64cc-412d-bbef-6d0e2fac4027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dc34a06f-e5bb-41d6-adb2-2c340bf7d75b tempest-ProjectReaderTests-698613123 None] Created volume successfully. Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637b6b7d-f133-4c0c-8f79-c39152ddc9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89', 'volume_size': 1, 'image_id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df266d7-e5b8-421f-ba71-c6332f852ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81a93ad54e6ef1e52cafa9e4ddb746ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '11aa9b17290b4e0b9dc5d08025cbcf0f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11e2ea705581d40e84bff506d1abba57a061fb9964548575d1169f4d4e0c6dc695df2920a113b9ef43246663bba540aaa86a1da2dad35b1429af5b28941eea67', 'id': '0df266d7-e5b8-421f-ba71-c6332f852ba2', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df266d7-e5b8-421f-ba71-c6332f852ba2/file', 'properties': {}}, 'image_service': }' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82efac91-a471-4989-bfbd-57cf29b9d33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Volume volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 (15ee64f9-bd29-4ab0-bcb8-4d931eea0e89): created successfully Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82efac91-a471-4989-bfbd-57cf29b9d33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Flow 'volume_create_manager' (df6fe8a7-5721-49bc-9e9e-8b09aa39d639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d9cba67b-505f-41b1-ab62-97c02a0e9420 tempest-VolumeImageDependencyTests-881655838 None] Created volume successfully. Jul 07 22:55:58 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 1073741824" returned: 0 in 0.873s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:58 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 Jul 07 22:55:58 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Acquiring lock "cinder-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "cinder-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Acquiring lock "cinder-a108878e-2385-43cb-8291-d9131fa98a85-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Acquiring lock "cinder-quobyte-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "cinder-a108878e-2385-43cb-8291-d9131fa98a85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "cinder-quobyte-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" acquired by "delete_volume" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Acquiring lock "cinder-quobyte-a108878e-2385-43cb-8291-d9131fa98a85" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99f122-7366-4a47-a854-3ae18b2e152e]: (4, 'raw') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "cinder-quobyte-a108878e-2385-43cb-8291-d9131fa98a85" acquired by "delete_volume" :: waited 0.034s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ed7c40-1466-4f59-94cf-6fcdeec12f80]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:59 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:59 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:59 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 Jul 07 22:55:59 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:59 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9" returned: 0 in 0.757s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9d7c16-02b9-497a-8f1d-784f484dcdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3207c12-a417-41c9-a22c-e20136a276b9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc425c42-3af6-4f79-b5a4-3fe2135fa60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:55:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Volume volume-d3207c12-a417-41c9-a22c-e20136a276b9 (d3207c12-a417-41c9-a22c-e20136a276b9): created successfully Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc425c42-3af6-4f79-b5a4-3fe2135fa60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (73728372-5c40-4f1d-a2eb-ddce68d5fca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:55:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a5ae1d58-9749-477f-9e42-b6f71b0c8ce8 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f of volume d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f7c99a-3093-44b7-becb-f88276525501]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:59 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 0 in 0.836s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:59 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85" returned: 0 in 0.841s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:59 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85 Jul 07 22:55:59 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:59 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 Jul 07 22:55:59 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:59 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:55:59 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:00 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:00 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 1 in 0.764s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89' failed. Not Retrying. {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a108878e-2385-43cb-8291-d9131fa98a85" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:00 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89 Jul 07 22:56:00 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "cinder-quobyte-a108878e-2385-43cb-8291-d9131fa98a85" released by "delete_volume" :: held 1.602s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Created reservations ['a52d4219-d9e4-458f-bc35-c02cb5f4335a', '2857e3bb-a719-44f2-b6b3-d514a5642b9e', '8b7832b3-8057-45c7-a299-cea16f1904b2', '3d905e5d-844b-45d5-920a-6477c5b05f32'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:00 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9" returned: 0 in 0.938s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:00 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f 1G Jul 07 22:56:00 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:00 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:00 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:01 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" returned: 0 in 0.711s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "cinder-quobyte-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89" released by "delete_volume" :: held 2.398s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Created reservations ['b4f9fd91-cbfa-48b5-9edf-db2204772984', '6c5b5050-f32b-467a-8a55-4188402916b7', 'eec2ab96-a8d1-4ba1-beda-6797a57b624a', '07c83235-bf54-4042-9789-b19444fe1d01'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:01 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:01 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:01 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:01 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Deleted volume successfully. Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a8b91223-5133-4e90-8f49-8c4a61fffa7f tempest-ProjectReaderTests-698613123 None] Lock "cinder-a108878e-2385-43cb-8291-d9131fa98a85-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:01 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f 1G" returned: 0 in 1.002s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3207c12-a417-41c9-a22c-e20136a276b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:01 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3207c12-a417-41c9-a22c-e20136a276b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f Jul 07 22:56:01 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:02 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:02 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Deleted volume successfully. Jul 07 22:56:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e4e39c33-7612-409b-ad19-b37892a6303f tempest-VolumeImageDependencyTests-881655838 None] Lock "cinder-15ee64f9-bd29-4ab0-bcb8-4d931eea0e89-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:02 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3207c12-a417-41c9-a22c-e20136a276b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:02 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f is being set with open permissions: ugo+rw Jul 07 22:56:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:02 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f Jul 07 22:56:02 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:03 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" returned: 0 in 0.799s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:03 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info Jul 07 22:56:03 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:04 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:04 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info is being set with open permissions: ugo+rw Jul 07 22:56:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:04 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info Jul 07 22:56:04 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:05 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.info" returned: 0 in 0.791s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.311s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a0cb71b0-d59f-4a74-b9c0-4a4730e98dab tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f of volume d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26a1b4-0b33-45bd-a8f9-35d9eb64aa63]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:06 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f Jul 07 22:56:06 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (898a9223-852a-419f-b5f6-266de8b93af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ec1b8-5d37-44b9-b94c-1d9f4fadfc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ec1b8-5d37-44b9-b94c-1d9f4fadfc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151404764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db402c-cf4b-4d31-9fce-ff01f04ff985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:07Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b0fe69-a81b-4a76-8094-3f46e0262c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b0fe69-a81b-4a76-8094-3f46e0262c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9f7a2d-fc51-4f90-ae16-701774dc178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9f7a2d-fc51-4f90-ae16-701774dc178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73db402c-cf4b-4d31-9fce-ff01f04ff985', 'volume_name': 'volume-73db402c-cf4b-4d31-9fce-ff01f04ff985', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be478cf-9010-41fb-8394-9f28a8492bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be478cf-9010-41fb-8394-9f28a8492bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66368680-0287-460f-a284-f17686bccf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:06 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Volume 73db402c-cf4b-4d31-9fce-ff01f04ff985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73db402c-cf4b-4d31-9fce-ff01f04ff985', 'volume_size': 1} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151404764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db402c-cf4b-4d31-9fce-ff01f04ff985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:07Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Creating volume 73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:06 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:06 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 1073741824 Jul 07 22:56:06 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:07 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" returned: 0 in 0.962s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3207c12-a417-41c9-a22c-e20136a276b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[78063a88-1b9d-49c7-8ad3-2d0d4cc0663f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:07 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 Jul 07 22:56:07 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:07 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 1073741824" returned: 0 in 0.991s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:07 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 Jul 07 22:56:07 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:08 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9" returned: 0 in 0.922s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:08 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f Jul 07 22:56:08 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:08 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985" returned: 0 in 0.771s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66368680-0287-460f-a284-f17686bccf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73db402c-cf4b-4d31-9fce-ff01f04ff985', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523fbe66-36af-445c-ba20-88676e82008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:08 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Volume volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 (73db402c-cf4b-4d31-9fce-ff01f04ff985): created successfully Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523fbe66-36af-445c-ba20-88676e82008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:08 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (898a9223-852a-419f-b5f6-266de8b93af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:08 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-0fdb75c0-4424-4e17-b070-81e4295c1520 tempest-ProjectReaderTests-33891224 None] Created volume successfully. Jul 07 22:56:09 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:09 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f Jul 07 22:56:09 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:09 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9.58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f" released by "_delete_snapshot" :: held 3.643s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" released by "delete_snapshot" :: held 3.676s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Created reservations ['6775bc56-afb3-4966-8656-59393aae2169', 'c3abb128-e078-4ad1-b38a-fdf845f2b931', '47f89f1f-64ab-455a-9fc3-b17d4188cd61', '56a635b8-cb81-42d2-b369-12a51f9631b4'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Creating offline snapshot 86884044-15e0-45be-a83b-1033f677fcbb of volume 73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4835451-a3b9-44d0-ad17-f0ea9095b11d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5421c8b1-ba24-4d9b-b7ed-5d341f8cfbde tempest-ProjectMemberTests-2095483305 None] Lock "cinder-58ddef0d-6cbe-4f18-9c08-260dd4f7bb2f-delete_snapshot" released by "delete_snapshot" :: held 3.954s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:10 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 Jul 07 22:56:10 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-d3207c12-a417-41c9-a22c-e20136a276b9-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-d3207c12-a417-41c9-a22c-e20136a276b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94866d8-62b4-4b06-a77f-8da2abc6cc90]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:10 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 Jul 07 22:56:10 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:11 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985" returned: 0 in 0.889s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:11 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb 1G Jul 07 22:56:11 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:11 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9" returned: 0 in 0.873s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:11 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9 Jul 07 22:56:11 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:12 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb 1G" returned: 0 in 0.961s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:12 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb Jul 07 22:56:12 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:12 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-d3207c12-a417-41c9-a22c-e20136a276b9" returned: 0 in 0.747s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-d3207c12-a417-41c9-a22c-e20136a276b9" released by "delete_volume" :: held 1.724s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Created reservations ['fa51bba0-3c05-465c-b456-ecccb5d94277', 'eabc04b9-681a-4ebe-94fc-8ba2c550b084', '63814d41-c200-43b1-8d03-e1ca9c501e4b', '383f988c-5f10-4fc2-b749-3579cf419744'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:12 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:12 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:12 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb" returned: 0 in 0.822s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:12 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb is being set with open permissions: ugo+rw Jul 07 22:56:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:12 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb Jul 07 22:56:12 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:13 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:13 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b48abfc8-2030-41be-8faf-a94619285a30 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-d3207c12-a417-41c9-a22c-e20136a276b9-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (72dcbda1-3b09-44ac-9ff1-00033ff155ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856022ff-2727-41e8-bcf6-68749941230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856022ff-2727-41e8-bcf6-68749941230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412183878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d158ad-5b1a-457c-82d3-2c9c15f89e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:13Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4a57ee-0e69-447a-9643-577c9a38c161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4a57ee-0e69-447a-9643-577c9a38c161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434d9ec0-3eed-49d0-8b19-d6b4918f8c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434d9ec0-3eed-49d0-8b19-d6b4918f8c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d158ad-5b1a-457c-82d3-2c9c15f89e0d', 'volume_name': 'volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c61a42-1812-4713-887d-81a1864faae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c61a42-1812-4713-887d-81a1864faae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c018b9e2-ae27-4d91-bb26-c7af61738e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:13 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Volume 21d158ad-5b1a-457c-82d3-2c9c15f89e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d', 'volume_size': 1} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:13 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb" returned: 0 in 0.904s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:13 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info Jul 07 22:56:13 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:14 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info" returned: 0 in 0.695s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:14 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info is being set with open permissions: ugo+rw Jul 07 22:56:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:14 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info Jul 07 22:56:14 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:15 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.info" returned: 0 in 0.694s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.065s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412183878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d158ad-5b1a-457c-82d3-2c9c15f89e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:13Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Creating volume 21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:15 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:15 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d 1073741824 Jul 07 22:56:15 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:15 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-848217ae-097b-4a31-820a-8bbb9a7c17de tempest-ProjectReaderTests-33891224 None] Create snapshot completed successfully Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:15 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:15 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-86884044-15e0-45be-a83b-1033f677fcbb-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-86884044-15e0-45be-a83b-1033f677fcbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-86884044-15e0-45be-a83b-1033f677fcbb" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-86884044-15e0-45be-a83b-1033f677fcbb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Deleting offline snapshot 86884044-15e0-45be-a83b-1033f677fcbb of volume 73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] snapshot_file for this snap is: volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b31db4e-53ba-4f8d-b17d-e4bca072f141]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:16 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb Jul 07 22:56:16 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:16 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:16 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d 1073741824" returned: 0 in 1.146s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:INSERT=41,cinder:UPDATE=170,cinder:SELECT=120,cinder:DELETE=11 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=123,cinder:INSERT=51,cinder:DELETE=16,cinder:UPDATE=159 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:16 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d Jul 07 22:56:16 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:16 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb" returned: 0 in 0.988s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73db402c-cf4b-4d31-9fce-ff01f04ff985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[78444ff1-9a00-4e7c-9386-5784944d26b5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:17 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 Jul 07 22:56:17 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:17 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" returned: 0 in 0.755s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c018b9e2-ae27-4d91-bb26-c7af61738e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa4345-5223-474c-b41f-1d32a5d9f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:17 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Volume volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d (21d158ad-5b1a-457c-82d3-2c9c15f89e0d): created successfully Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa4345-5223-474c-b41f-1d32a5d9f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (72dcbda1-3b09-44ac-9ff1-00033ff155ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:17 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-afa415d5-6dba-47d7-befa-732eea0cede3 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:56:17 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985" returned: 0 in 1.031s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:17 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb Jul 07 22:56:17 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:18 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:18 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb Jul 07 22:56:18 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 70a59080-330f-4d46-9930-a4ae49ec60a8 of volume 21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42da0d0-fbea-4194-a6a3-e9b0b5956708]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:19 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d Jul 07 22:56:19 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:19 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985.86884044-15e0-45be-a83b-1033f677fcbb" returned: 0 in 0.709s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-86884044-15e0-45be-a83b-1033f677fcbb" released by "_delete_snapshot" :: held 3.708s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:19 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" released by "delete_snapshot" :: held 3.739s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:19 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" returned: 0 in 0.814s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:19 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 1G Jul 07 22:56:19 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:20 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Created reservations ['2075c4e2-0926-4c42-8b60-9d80b89071fb', 'e4b095db-0451-4a7b-b7f7-094f4091be04', '2f16b114-27ab-40e0-9543-1e8af2c9f566', '5f25de44-acb3-4229-a60e-9c3958c44f21'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:20 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 1G" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:20 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 Jul 07 22:56:20 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:21 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8" returned: 0 in 0.763s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:21 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 is being set with open permissions: ugo+rw Jul 07 22:56:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:21 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 Jul 07 22:56:21 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:22 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8" returned: 0 in 0.687s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Delete snapshot completed successfully. Jul 07 22:56:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-aa4cbe86-c6f8-4644-97f3-91fe86fb5aa0 tempest-ProjectReaderTests-33891224 None] Lock "cinder-86884044-15e0-45be-a83b-1033f677fcbb-delete_snapshot" released by "delete_snapshot" :: held 6.895s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:23 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info Jul 07 22:56:23 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-73db402c-cf4b-4d31-9fce-ff01f04ff985-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "cinder-73db402c-cf4b-4d31-9fce-ff01f04ff985-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" acquired by "delete_volume" :: waited 0.031s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[47deef1c-754f-49bb-85a3-a7cdb306508a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:23 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info" returned: 0 in 0.714s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:23 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info is being set with open permissions: ugo+rw Jul 07 22:56:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:24 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info Jul 07 22:56:24 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:24 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 Jul 07 22:56:24 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:24 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.info" returned: 0 in 0.782s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.850s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:24 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-222e46f8-077b-4a2c-99ef-23ab5b47b84e tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:56:24 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985" returned: 0 in 0.948s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:24 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985 Jul 07 22:56:24 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-70a59080-330f-4d46-9930-a4ae49ec60a8-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-70a59080-330f-4d46-9930-a4ae49ec60a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-70a59080-330f-4d46-9930-a4ae49ec60a8" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:25 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-70a59080-330f-4d46-9930-a4ae49ec60a8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 70a59080-330f-4d46-9930-a4ae49ec60a8 of volume 21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-73db402c-cf4b-4d31-9fce-ff01f04ff985" returned: 0 in 0.719s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[be053eb7-b710-42a3-b6f7-b1307e9c53a9]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-73db402c-cf4b-4d31-9fce-ff01f04ff985" released by "delete_volume" :: held 1.773s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Created reservations ['8174f8ae-5228-417e-b588-cd5129477f3e', '98545760-d77b-4ceb-b77c-1c8a4bbfa1d9', '19099066-5157-444d-8d72-0067b76b3825', 'de789768-a21b-40d0-a59d-0adf5dc7848a'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:25 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 Jul 07 22:56:25 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:25 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:25 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:26 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c363213-4bdd-49e8-bebf-848b38f962bb]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:26 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:26 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Deleted volume successfully. Jul 07 22:56:26 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b6d926cb-8b4b-4e5f-ac21-6d5d4b913c1e tempest-ProjectReaderTests-33891224 None] Lock "cinder-73db402c-cf4b-4d31-9fce-ff01f04ff985-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:26 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d Jul 07 22:56:26 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:27 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (a4bf0c04-713a-445b-8ebe-7feb154c7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a008a-de88-4183-bd5b-d95130d704c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" returned: 0 in 0.907s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a008a-de88-4183-bd5b-d95130d704c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780243921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa4ad44-764c-4fac-88cb-e4aea5eb855d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:27Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:27 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 Jul 07 22:56:27 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be38d5a3-64bc-47ec-a577-b4a6ed5d039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be38d5a3-64bc-47ec-a577-b4a6ed5d039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c98cf-a282-4d38-bd54-e1d987bb482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c98cf-a282-4d38-bd54-e1d987bb482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa4ad44-764c-4fac-88cb-e4aea5eb855d', 'volume_name': 'volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be2756-e948-4162-8409-57f845f747ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be2756-e948-4162-8409-57f845f747ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3b1302-f17c-4b27-89f8-1b75c3842290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:27 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Volume 6fa4ad44-764c-4fac-88cb-e4aea5eb855d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d', 'volume_size': 1} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780243921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa4ad44-764c-4fac-88cb-e4aea5eb855d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:27Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Creating volume 6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:27 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:27 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d 1073741824 Jul 07 22:56:27 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:28 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8" returned: 0 in 0.851s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:28 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8 Jul 07 22:56:28 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:28 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d 1073741824" returned: 0 in 0.860s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:28 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d Jul 07 22:56:28 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:28 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d.70a59080-330f-4d46-9930-a4ae49ec60a8" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-70a59080-330f-4d46-9930-a4ae49ec60a8" released by "_delete_snapshot" :: held 3.386s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" released by "delete_snapshot" :: held 3.417s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Created reservations ['f9895337-cf18-412f-ae68-bc9dfc0100fb', '535caa81-ac4c-4f17-8ff4-fbf3c18d4415', 'c796e1b7-0594-47a3-ae24-d710d510f90a', 'eade087e-665c-4bd3-8843-554add62fbb6'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:56:29 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-8fc70197-3b48-4f52-9236-f049c3d2d1e3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-70a59080-330f-4d46-9930-a4ae49ec60a8-delete_snapshot" released by "delete_snapshot" :: held 3.585s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" returned: 0 in 0.768s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3b1302-f17c-4b27-89f8-1b75c3842290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef0e187-4512-4ac8-9246-4b4701931f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:29 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Volume volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d (6fa4ad44-764c-4fac-88cb-e4aea5eb855d): created successfully Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef0e187-4512-4ac8-9246-4b4701931f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (a4bf0c04-713a-445b-8ebe-7feb154c7322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:29 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-928f6caa-01c0-4cc3-b19f-de3559e53d4a tempest-ProjectReaderTests-33891224 None] Created volume successfully. Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Creating offline snapshot 0b9222c2-92e0-4a18-be4b-11d951ca1571 of volume 6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f93a7-9a54-48c9-ba65-56a7ffa35541]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:29 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d Jul 07 22:56:29 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-21d158ad-5b1a-457c-82d3-2c9c15f89e0d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-21d158ad-5b1a-457c-82d3-2c9c15f89e0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec304633-36b8-42c6-88af-f3d3b6224225]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:29 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d Jul 07 22:56:29 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:30 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" returned: 0 in 0.864s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:30 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 1G Jul 07 22:56:30 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:30 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" returned: 0 in 0.828s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:30 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d Jul 07 22:56:30 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:31 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 1G" returned: 0 in 0.940s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:31 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 Jul 07 22:56:31 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:31 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" returned: 0 in 0.753s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-21d158ad-5b1a-457c-82d3-2c9c15f89e0d" released by "delete_volume" :: held 1.647s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Created reservations ['79cfb817-342d-44ea-8024-9a3cdfd97f1a', '6ec38a4e-3bdf-4333-b66f-f3e9805b2804', 'caa89a08-f6a8-4ed4-9582-599a75f4dd5e', '7343b1c5-988f-47fc-b4cf-f5bf5ffa1617'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:31 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:31 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:32 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571" returned: 0 in 0.832s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:32 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 is being set with open permissions: ugo+rw Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:32 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 Jul 07 22:56:32 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:32 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.771s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:32 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-184dd595-0cad-4dcd-a189-f3868acbaf81 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-21d158ad-5b1a-457c-82d3-2c9c15f89e0d-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (31c404c5-762a-4bc9-a755-9cea938e5948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a435f0d-8205-4066-b20c-e3633448bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a435f0d-8205-4066-b20c-e3633448bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373102871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813500fb-df7f-4051-a17a-56297a4505b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:33Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9569c-3b8c-4a3d-b129-969e233b69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9569c-3b8c-4a3d-b129-969e233b69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b18c879-b4ff-44e2-9640-c36b5f1e533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b18c879-b4ff-44e2-9640-c36b5f1e533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813500fb-df7f-4051-a17a-56297a4505b9', 'volume_name': 'volume-813500fb-df7f-4051-a17a-56297a4505b9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7809126c-fd60-4f36-b042-b436b46434ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7809126c-fd60-4f36-b042-b436b46434ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb7bafb-e695-4813-a31f-aaf9dc717364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Volume 813500fb-df7f-4051-a17a-56297a4505b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813500fb-df7f-4051-a17a-56297a4505b9', 'volume_size': 1} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:32 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571" returned: 0 in 0.737s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:33 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info Jul 07 22:56:33 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:33 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info" returned: 0 in 0.692s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:33 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info is being set with open permissions: ugo+rw Jul 07 22:56:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:33 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info Jul 07 22:56:33 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:34 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.info" returned: 0 in 0.649s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373102871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813500fb-df7f-4051-a17a-56297a4505b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:33Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Creating volume 813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:34 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:34 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 1073741824 Jul 07 22:56:34 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-185fa928-7ad1-49fd-aed6-407372cf0189 tempest-ProjectReaderTests-33891224 None] Create snapshot completed successfully Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-0b9222c2-92e0-4a18-be4b-11d951ca1571-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-0b9222c2-92e0-4a18-be4b-11d951ca1571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-0b9222c2-92e0-4a18-be4b-11d951ca1571" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-0b9222c2-92e0-4a18-be4b-11d951ca1571" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Deleting offline snapshot 0b9222c2-92e0-4a18-be4b-11d951ca1571 of volume 6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] snapshot_file for this snap is: volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf0af89-652f-4498-9715-82a76681894c]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:35 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 Jul 07 22:56:35 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:35 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 1073741824" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:35 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 Jul 07 22:56:35 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:35 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571" returned: 0 in 0.800s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9503f7-cf9e-4144-9528-bdabbe7bfcf2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:35 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d Jul 07 22:56:35 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:35 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9" returned: 0 in 0.640s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb7bafb-e695-4813-a31f-aaf9dc717364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813500fb-df7f-4051-a17a-56297a4505b9', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5802e65a-d369-4a25-8c29-383eeaff3244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Volume volume-813500fb-df7f-4051-a17a-56297a4505b9 (813500fb-df7f-4051-a17a-56297a4505b9): created successfully Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5802e65a-d369-4a25-8c29-383eeaff3244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (31c404c5-762a-4bc9-a755-9cea938e5948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:35 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-08eb7a6f-14af-4b90-b167-44d0db1d1ef7 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:56:36 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" returned: 0 in 0.719s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:36 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 Jul 07 22:56:36 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 43b697a9-f93e-495c-b8b4-8bf9cfe46a1f of volume 813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf3618b-b483-4e9f-b09e-4c19f15308f8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:37 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 Jul 07 22:56:37 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:37 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571" returned: 0 in 0.725s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:37 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571 Jul 07 22:56:37 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:37 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:37 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f 1G Jul 07 22:56:37 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:37 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d.0b9222c2-92e0-4a18-be4b-11d951ca1571" returned: 0 in 0.621s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-0b9222c2-92e0-4a18-be4b-11d951ca1571" released by "_delete_snapshot" :: held 2.982s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" released by "delete_snapshot" :: held 3.008s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Created reservations ['bfaedfd4-8612-4861-b875-ea3b5c9909f6', 'e8d17303-c80d-4eaf-8f5b-c3213336272c', 'd71ee3e9-b0a0-4159-8ab4-e57d70a74b8f', '944806f1-10ae-4c0b-bb03-88569e616bfd'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:37 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Delete snapshot completed successfully. Jul 07 22:56:37 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-d9d173a0-09f6-4b9d-ba01-bffdd90a5de8 tempest-ProjectReaderTests-33891224 None] Lock "cinder-0b9222c2-92e0-4a18-be4b-11d951ca1571-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:38 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f 1G" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813500fb-df7f-4051-a17a-56297a4505b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:38 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813500fb-df7f-4051-a17a-56297a4505b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f Jul 07 22:56:38 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-6fa4ad44-764c-4fac-88cb-e4aea5eb855d-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "cinder-6fa4ad44-764c-4fac-88cb-e4aea5eb855d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" acquired by "delete_volume" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14da13a-10f8-4703-a808-e40d6b070996]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:39 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813500fb-df7f-4051-a17a-56297a4505b9 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" returned: 0 in 0.722s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:39 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f is being set with open permissions: ugo+rw Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:39 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f Jul 07 22:56:39 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:39 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d Jul 07 22:56:39 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:39 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" returned: 0 in 0.645s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:39 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" returned: 0 in 0.745s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:39 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d Jul 07 22:56:39 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:39 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info Jul 07 22:56:39 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:40 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" returned: 0 in 0.670s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-6fa4ad44-764c-4fac-88cb-e4aea5eb855d" released by "delete_volume" :: held 1.478s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:40 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info" returned: 0 in 0.698s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:40 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info is being set with open permissions: ugo+rw Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:40 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info Jul 07 22:56:40 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Created reservations ['2a562939-446f-4ad4-9d85-2c0e642f07e7', 'bdfdbedb-6421-4f6c-9d41-cce85253d3dd', '1ac65a05-c9f4-4aa3-97dd-8937c8f9f195', 'ec57117c-264e-4e3f-bbac-d7c70315502a'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:40 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:40 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:41 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.info" returned: 0 in 0.641s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-37d74d13-b62d-4d6f-8aa8-706334f8076a tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:56:41 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.654s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Deleted volume successfully. Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-6c7fe2ab-2949-4595-9a29-04fffd5a785f tempest-ProjectReaderTests-33891224 None] Lock "cinder-6fa4ad44-764c-4fac-88cb-e4aea5eb855d-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (d9e2c15e-397a-457f-a7e5-bcde2476a39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff59054f-92a6-4571-a248-0c0a52bc1a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff59054f-92a6-4571-a248-0c0a52bc1a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659616715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916b8929-8318-4408-a34b-fdb293b767b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:42Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0230128-9073-43de-a769-b24b905dce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0230128-9073-43de-a769-b24b905dce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb60bd2-8ae9-44c7-847d-cb30435ec9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb60bd2-8ae9-44c7-847d-cb30435ec9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916b8929-8318-4408-a34b-fdb293b767b4', 'volume_name': 'volume-916b8929-8318-4408-a34b-fdb293b767b4', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5638046a-d56a-4b26-9cc6-cedd77811ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5638046a-d56a-4b26-9cc6-cedd77811ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdacf554-780a-4dcf-bb93-f29971f4e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:41 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Volume 916b8929-8318-4408-a34b-fdb293b767b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916b8929-8318-4408-a34b-fdb293b767b4', 'volume_size': 1} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659616715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916b8929-8318-4408-a34b-fdb293b767b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:42Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Creating volume 916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:41 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:41 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 1073741824 Jul 07 22:56:41 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 43b697a9-f93e-495c-b8b4-8bf9cfe46a1f of volume 813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72813dd-fadf-46e0-aeb1-67ca18d01d1a]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:42 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f Jul 07 22:56:42 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:42 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 1073741824" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:42 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 Jul 07 22:56:42 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:43 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" returned: 0 in 0.820s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813500fb-df7f-4051-a17a-56297a4505b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db2d7e-28a9-43cd-ab7b-c619d060bdac]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:43 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 Jul 07 22:56:43 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:43 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4" returned: 0 in 0.707s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdacf554-780a-4dcf-bb93-f29971f4e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916b8929-8318-4408-a34b-fdb293b767b4', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95178f63-0ac7-422f-b6a6-2a41dfe01c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:43 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Volume volume-916b8929-8318-4408-a34b-fdb293b767b4 (916b8929-8318-4408-a34b-fdb293b767b4): created successfully Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95178f63-0ac7-422f-b6a6-2a41dfe01c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (d9e2c15e-397a-457f-a7e5-bcde2476a39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:43 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f6d92393-8590-4aaf-859b-884d0ba93bf6 tempest-ProjectReaderTests-33891224 None] Created volume successfully. Jul 07 22:56:43 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:43 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f Jul 07 22:56:43 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Creating offline snapshot 26af7146-9175-47f1-a82e-f4c77060b123 of volume 916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8819e1-d9f0-411a-84ab-0027f9ed29f8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:44 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 Jul 07 22:56:44 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:44 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" returned: 0 in 0.782s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:44 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f Jul 07 22:56:44 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:44 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4" returned: 0 in 0.806s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:44 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 1G Jul 07 22:56:44 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:45 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9.43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" returned: 0 in 0.691s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f" released by "_delete_snapshot" :: held 3.167s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" released by "delete_snapshot" :: held 3.194s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Created reservations ['b76d25f6-bddf-4f8f-993e-199f3b517acc', '7953c86a-ab6e-47cf-8315-126c9619ad40', '51badfce-39b1-4fa0-a7a5-9694ed27fb01', 'a3886558-3247-4800-8270-4c3bd9fdccda'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:45 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-c5b9c4a6-76b5-422d-a32e-05cb7c88730f tempest-ProjectMemberTests-2095483305 None] Lock "cinder-43b697a9-f93e-495c-b8b4-8bf9cfe46a1f-delete_snapshot" released by "delete_snapshot" :: held 3.338s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:45 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 1G" returned: 0 in 0.864s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916b8929-8318-4408-a34b-fdb293b767b4 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:45 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916b8929-8318-4408-a34b-fdb293b767b4 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 Jul 07 22:56:45 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:46 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-813500fb-df7f-4051-a17a-56297a4505b9-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916b8929-8318-4408-a34b-fdb293b767b4 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:46 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 is being set with open permissions: ugo+rw Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "cinder-813500fb-df7f-4051-a17a-56297a4505b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:46 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 Jul 07 22:56:46 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb10a2a4-f7e7-488e-9649-79fc18adb64f]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:46 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:46 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 Jul 07 22:56:46 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:47 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123" returned: 0 in 0.723s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:47 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info Jul 07 22:56:47 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:47 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9" returned: 0 in 0.796s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:47 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9 Jul 07 22:56:47 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:47 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info" returned: 0 in 0.685s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:47 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info is being set with open permissions: ugo+rw Jul 07 22:56:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:47 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info Jul 07 22:56:47 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:48 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-813500fb-df7f-4051-a17a-56297a4505b9" returned: 0 in 0.707s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-813500fb-df7f-4051-a17a-56297a4505b9" released by "delete_volume" :: held 1.568s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Created reservations ['c84b8299-f09f-4d3b-bd5d-6b512da90807', 'c8d3fcc7-0fbc-4e57-8772-7f7ee2e10866', '83d10334-6b95-4c9d-864a-92638c53f508', 'ac83cc93-7396-44b6-aa12-b98706828567'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:48 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:48 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:48 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.info" returned: 0 in 0.751s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fbe5a421-c021-4f71-a638-651b7a70f1d1 tempest-ProjectReaderTests-33891224 None] Create snapshot completed successfully Jul 07 22:56:48 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.658s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:56:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-b0ff850a-d370-4c6f-a4db-790845b3218e tempest-ProjectMemberTests-2095483305 None] Lock "cinder-813500fb-df7f-4051-a17a-56297a4505b9-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (7c8b2204-cede-486e-94f4-7b7ab6349b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2cb6ec-2d54-452e-b33a-4acc192e251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2cb6ec-2d54-452e-b33a-4acc192e251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656559608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7334373a-9690-4f16-9427-1302c46c4fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:49Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1fb04e-7625-4225-8f86-9e81709a7cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1fb04e-7625-4225-8f86-9e81709a7cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a6f035-ed64-4572-8d3d-a216ef7d0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a6f035-ed64-4572-8d3d-a216ef7d0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7334373a-9690-4f16-9427-1302c46c4fb0', 'volume_name': 'volume-7334373a-9690-4f16-9427-1302c46c4fb0', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2a8b0-2e9d-454d-af86-436258c260dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2a8b0-2e9d-454d-af86-436258c260dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7742550-777c-495c-96b0-7e0b9bebc641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:49 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Volume 7334373a-9690-4f16-9427-1302c46c4fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7334373a-9690-4f16-9427-1302c46c4fb0', 'volume_size': 1} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656559608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7334373a-9690-4f16-9427-1302c46c4fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:49Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Creating volume 7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:49 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:49 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 1073741824 Jul 07 22:56:49 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-26af7146-9175-47f1-a82e-f4c77060b123-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-26af7146-9175-47f1-a82e-f4c77060b123-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-26af7146-9175-47f1-a82e-f4c77060b123" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-26af7146-9175-47f1-a82e-f4c77060b123" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Deleting offline snapshot 26af7146-9175-47f1-a82e-f4c77060b123 of volume 916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] snapshot_file for this snap is: volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f25122-d2bd-4bc9-9220-add495b20be1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:49 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 Jul 07 22:56:49 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:50 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 1073741824" returned: 0 in 0.900s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:50 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123" returned: 0 in 0.821s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916b8929-8318-4408-a34b-fdb293b767b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:50 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 Jul 07 22:56:50 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9231d1-9637-4494-88a5-6cea0fea3373]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:50 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 Jul 07 22:56:50 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:50 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0" returned: 0 in 0.664s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7742550-777c-495c-96b0-7e0b9bebc641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7334373a-9690-4f16-9427-1302c46c4fb0', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df65e259-14eb-4a7e-8733-db47ed9a7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:50 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Volume volume-7334373a-9690-4f16-9427-1302c46c4fb0 (7334373a-9690-4f16-9427-1302c46c4fb0): created successfully Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df65e259-14eb-4a7e-8733-db47ed9a7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (7c8b2204-cede-486e-94f4-7b7ab6349b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:50 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7628410e-5dbb-4483-adde-22ae458892d5 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:56:50 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4" returned: 0 in 0.755s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:50 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 Jul 07 22:56:50 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot cbef2664-758a-45ee-acd1-721a38071d74 of volume 7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca7b28-3e55-4fe1-b74c-567833bacc28]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:51 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 Jul 07 22:56:51 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:51 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:51 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123 Jul 07 22:56:51 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:52 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0" returned: 0 in 0.862s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:52 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 1G Jul 07 22:56:52 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:52 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4.26af7146-9175-47f1-a82e-f4c77060b123" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-26af7146-9175-47f1-a82e-f4c77060b123" released by "_delete_snapshot" :: held 3.257s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" released by "delete_snapshot" :: held 3.284s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Created reservations ['96d57b31-07f5-41d0-9704-3695de20b38d', 'e128e632-e4c4-41b1-81ef-9c5a2a1456c3', 'e5ba215c-07f1-4ba4-9e45-ca560682d05f', '7a5cfa75-7048-4c4d-a09d-f483a9869eeb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Delete snapshot completed successfully. Jul 07 22:56:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3dfd7378-30dc-4e6d-a2a9-c632e6deaf05 tempest-ProjectReaderTests-33891224 None] Lock "cinder-26af7146-9175-47f1-a82e-f4c77060b123-delete_snapshot" released by "delete_snapshot" :: held 3.452s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:53 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 1G" returned: 0 in 0.919s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7334373a-9690-4f16-9427-1302c46c4fb0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:53 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7334373a-9690-4f16-9427-1302c46c4fb0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 Jul 07 22:56:53 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-916b8929-8318-4408-a34b-fdb293b767b4-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "cinder-916b8929-8318-4408-a34b-fdb293b767b4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[693f0f02-a715-4797-8d7b-c4f47c13edce]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:53 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 Jul 07 22:56:53 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:54 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7334373a-9690-4f16-9427-1302c46c4fb0 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:54 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 is being set with open permissions: ugo+rw Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:54 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 Jul 07 22:56:54 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:54 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4" returned: 0 in 0.852s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:54 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4 Jul 07 22:56:54 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:54 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74" returned: 0 in 0.712s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:54 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info Jul 07 22:56:54 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:55 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-916b8929-8318-4408-a34b-fdb293b767b4" returned: 0 in 0.715s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-916b8929-8318-4408-a34b-fdb293b767b4" released by "delete_volume" :: held 1.650s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Created reservations ['1c0fa739-50ab-41b4-b4e6-f2e0b6a341bb', 'b10b1ffc-5cd5-43a1-91fa-a7e4bc0d7e0b', '13193c65-b8aa-4438-9a73-7a8e1619919a', 'c00714e2-b75c-486c-b101-fe16aec0583b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:55 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:56:55 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:55 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:55 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info is being set with open permissions: ugo+rw Jul 07 22:56:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:55 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info Jul 07 22:56:55 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:56 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.info" returned: 0 in 0.711s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:56 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.845s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.850s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:56:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Deleted volume successfully. Jul 07 22:56:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dc463eba-b761-4ccc-98f5-2cb42884f7c9 tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (26bf5bb2-b45b-4705-bcad-db37005094da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dd267d-0f88-4ff4-be80-ddbfe0871b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9d8414ac-7442-4842-915e-6e31a1a122ae tempest-ProjectReaderTests-33891224 None] Lock "cinder-916b8929-8318-4408-a34b-fdb293b767b4-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dd267d-0f88-4ff4-be80-ddbfe0871b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215338703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b5f172-efdc-4523-acbd-7306c100bf43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:56Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e828a3-fd4a-4b7b-954c-4da6da3c1a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e828a3-fd4a-4b7b-954c-4da6da3c1a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605c6a1-ca77-4aa7-ae20-862264dd9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605c6a1-ca77-4aa7-ae20-862264dd9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b5f172-efdc-4523-acbd-7306c100bf43', 'volume_name': 'volume-a8b5f172-efdc-4523-acbd-7306c100bf43', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c927e037-c10c-4048-b055-14fee30679ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c927e037-c10c-4048-b055-14fee30679ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294a09d2-a53c-49c4-a946-1ac589298db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:56 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Volume a8b5f172-efdc-4523-acbd-7306c100bf43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b5f172-efdc-4523-acbd-7306c100bf43', 'volume_size': 1} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215338703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b5f172-efdc-4523-acbd-7306c100bf43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:56Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Creating volume a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:56:56 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:56 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 1073741824 Jul 07 22:56:56 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-cbef2664-758a-45ee-acd1-721a38071d74-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-cbef2664-758a-45ee-acd1-721a38071d74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-cbef2664-758a-45ee-acd1-721a38071d74" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-cbef2664-758a-45ee-acd1-721a38071d74" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot cbef2664-758a-45ee-acd1-721a38071d74 of volume 7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6bab4-1151-44f0-885c-016094592ff5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:56 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 Jul 07 22:56:56 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:57 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 1073741824" returned: 0 in 0.905s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:57 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 Jul 07 22:56:57 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:57 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74" returned: 0 in 0.823s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7334373a-9690-4f16-9427-1302c46c4fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217b1e8-0675-4075-ad7e-1e3ecddb14ac]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:57 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 Jul 07 22:56:57 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:57 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43" returned: 0 in 0.637s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294a09d2-a53c-49c4-a946-1ac589298db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b5f172-efdc-4523-acbd-7306c100bf43', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182c54bd-3a98-4009-bbb5-18b3195fed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:56:58 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Volume volume-a8b5f172-efdc-4523-acbd-7306c100bf43 (a8b5f172-efdc-4523-acbd-7306c100bf43): created successfully Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182c54bd-3a98-4009-bbb5-18b3195fed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (26bf5bb2-b45b-4705-bcad-db37005094da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:56:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7114af67-4361-4c0e-a01a-7176ca44d4d3 tempest-ProjectReaderTests-33891224 None] Created volume successfully. Jul 07 22:56:58 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:58 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 Jul 07 22:56:58 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Creating offline snapshot 9d3d9dc7-57ab-4098-82c0-8790a6d202c3 of volume a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a7e2c-97ef-4df2-8971-c71e641a88bc]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:56:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:58 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 Jul 07 22:56:58 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:59 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74" returned: 0 in 0.802s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:59 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74 Jul 07 22:56:59 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:59 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:56:59 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 1G Jul 07 22:56:59 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:56:59 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0.cbef2664-758a-45ee-acd1-721a38071d74" returned: 0 in 0.701s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-cbef2664-758a-45ee-acd1-721a38071d74" released by "_delete_snapshot" :: held 3.209s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" released by "delete_snapshot" :: held 3.235s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:56:59 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Created reservations ['9eac5e6a-dc90-4e08-b37c-91aaaaab4f92', 'a9f9e73b-adae-4fe0-85d3-fcc35c360ce6', '291a18f5-d77e-430c-a3d6-3d75cf5dbe2f', 'b3ff58aa-d36d-43df-ba39-2366859a6840'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:56:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4c256334-7b42-491e-b170-bf8be5b6d0b4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-cbef2664-758a-45ee-acd1-721a38071d74-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:00 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 1G" returned: 0 in 0.859s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b5f172-efdc-4523-acbd-7306c100bf43 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:00 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b5f172-efdc-4523-acbd-7306c100bf43 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 Jul 07 22:57:00 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-7334373a-9690-4f16-9427-1302c46c4fb0-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-7334373a-9690-4f16-9427-1302c46c4fb0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" acquired by "delete_volume" :: waited 0.017s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c24f4a-8e44-4bfc-8e7d-351ec114fe09]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:01 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 Jul 07 22:57:01 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:01 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b5f172-efdc-4523-acbd-7306c100bf43 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3" returned: 0 in 0.897s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:01 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 is being set with open permissions: ugo+rw Jul 07 22:57:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:01 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 Jul 07 22:57:01 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:01 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0" returned: 0 in 0.807s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:01 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0 Jul 07 22:57:01 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:01 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3" returned: 0 in 0.792s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:02 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info Jul 07 22:57:02 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:02 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-7334373a-9690-4f16-9427-1302c46c4fb0" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-7334373a-9690-4f16-9427-1302c46c4fb0" released by "delete_volume" :: held 1.674s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Created reservations ['22cb664d-04c6-49c7-9964-b57e87e7ff26', '076aeef1-fcc5-4a6c-9e24-d2e0a0e469c8', '5c8e5135-716c-4f88-b5ce-9a00a58db63f', 'ec31bde4-c6c6-420b-9cd0-6d838685cf1e'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:02 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info" returned: 0 in 0.707s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:02 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info is being set with open permissions: ugo+rw Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:02 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info Jul 07 22:57:02 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:02 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:02 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:03 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.info" returned: 0 in 0.847s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.069s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:03 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-03e9c67a-0e53-4d94-88da-998d3257391f tempest-ProjectReaderTests-33891224 None] Create snapshot completed successfully Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (361f2c25-bb2b-49ac-89fb-207f1031ede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9f0667-f93b-41d4-8512-59437f86f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:03 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9f0667-f93b-41d4-8512-59437f86f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447583496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9bc819-2a65-40c8-9d80-62ceb1023585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:04Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10849ab9-11ae-4e64-8aac-e419de1d170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10849ab9-11ae-4e64-8aac-e419de1d170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7e47f3-fd41-4d65-afaf-123e9275513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7e47f3-fd41-4d65-afaf-123e9275513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9bc819-2a65-40c8-9d80-62ceb1023585', 'volume_name': 'volume-bb9bc819-2a65-40c8-9d80-62ceb1023585', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61662b98-0367-4a30-9b40-4470c8d7fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61662b98-0367-4a30-9b40-4470c8d7fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04282ac0-758c-4a4b-8e0e-6694586603d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:03 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Volume bb9bc819-2a65-40c8-9d80-62ceb1023585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9bc819-2a65-40c8-9d80-62ceb1023585', 'volume_size': 1} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447583496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9bc819-2a65-40c8-9d80-62ceb1023585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:04Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Creating volume bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:03 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-9d3d9dc7-57ab-4098-82c0-8790a6d202c3-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e439fe7f-5e6c-4a3d-99e7-f0ed903c4be3 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-7334373a-9690-4f16-9427-1302c46c4fb0-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:03 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 1073741824 Jul 07 22:57:03 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-9d3d9dc7-57ab-4098-82c0-8790a6d202c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-9d3d9dc7-57ab-4098-82c0-8790a6d202c3" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-9d3d9dc7-57ab-4098-82c0-8790a6d202c3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Deleting offline snapshot 9d3d9dc7-57ab-4098-82c0-8790a6d202c3 of volume a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] snapshot_file for this snap is: volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5150b3-9eb2-434a-9e1c-bf2524725ba5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:04 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 Jul 07 22:57:04 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:04 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 1073741824" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:04 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 Jul 07 22:57:04 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:04 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3" returned: 0 in 0.846s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b5f172-efdc-4523-acbd-7306c100bf43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991a05b-1a32-4129-9e3d-5ad11fd89e72]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:04 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 Jul 07 22:57:04 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:05 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585" returned: 0 in 0.730s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04282ac0-758c-4a4b-8e0e-6694586603d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9bc819-2a65-40c8-9d80-62ceb1023585', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5ce9d1-e780-4e52-afa0-c98543932fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:05 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Volume volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 (bb9bc819-2a65-40c8-9d80-62ceb1023585): created successfully Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5ce9d1-e780-4e52-afa0-c98543932fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (361f2c25-bb2b-49ac-89fb-207f1031ede1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:05 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-d9033f76-a421-456e-80d9-80cb545fca83 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:57:05 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43" returned: 0 in 0.801s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:05 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 Jul 07 22:57:05 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 98ba233f-b9a7-4150-9602-8ad779da97dd of volume bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80f596a-e974-45da-aadf-06cfcf5846ad]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:06 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 Jul 07 22:57:06 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:06 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3" returned: 0 in 0.781s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:06 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3 Jul 07 22:57:06 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:06 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585" returned: 0 in 0.770s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:06 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd 1G Jul 07 22:57:06 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:07 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43.9d3d9dc7-57ab-4098-82c0-8790a6d202c3" returned: 0 in 0.707s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-9d3d9dc7-57ab-4098-82c0-8790a6d202c3" released by "_delete_snapshot" :: held 3.232s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" released by "delete_snapshot" :: held 3.255s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Created reservations ['f1eac11d-bb00-4865-9eb8-9c9520a7c0ac', 'c8e40916-52b9-4887-ac2d-217198979446', 'f7f8d454-1edc-48fa-bfe0-c0804f19ebad', '2bc24ac9-135a-4093-b74b-34d8fc997da5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Delete snapshot completed successfully. Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-e509dbd7-c9a7-4d59-935e-2963aa83269e tempest-ProjectReaderTests-33891224 None] Lock "cinder-9d3d9dc7-57ab-4098-82c0-8790a6d202c3-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:07 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd 1G" returned: 0 in 0.877s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:07 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd Jul 07 22:57:07 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-a8b5f172-efdc-4523-acbd-7306c100bf43-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "cinder-a8b5f172-efdc-4523-acbd-7306c100bf43-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981bdba-7205-4de1-936b-181c3b1ab537]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:08 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd" returned: 0 in 0.697s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:08 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd is being set with open permissions: ugo+rw Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:08 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 Jul 07 22:57:08 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:08 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd Jul 07 22:57:08 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:08 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43" returned: 0 in 0.738s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:08 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd" returned: 0 in 0.649s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:08 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43 Jul 07 22:57:08 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:09 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info Jul 07 22:57:09 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:09 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-a8b5f172-efdc-4523-acbd-7306c100bf43" returned: 0 in 0.643s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-a8b5f172-efdc-4523-acbd-7306c100bf43" released by "delete_volume" :: held 1.439s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:09 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Created reservations ['652b3ea1-30d7-4492-a42b-b7ddadd939ef', '2aed01d7-4703-4c3f-8864-8e064b1d6550', 'f86b6b16-9a56-4322-b24a-c24dcd65651b', '92351844-8cf9-46f2-9eb5-19e4f542dc49'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:09 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info is being set with open permissions: ugo+rw Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:09 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info Jul 07 22:57:09 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:09 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:09 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:10 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.info" returned: 0 in 0.653s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-67331f3e-f1f7-410d-9e6f-58a913cbf363 tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:57:10 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.675s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:10 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Deleted volume successfully. Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-9c277ef5-532d-4646-a78c-e0752c546a80 tempest-ProjectReaderTests-33891224 None] Lock "cinder-a8b5f172-efdc-4523-acbd-7306c100bf43-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (fba124fe-921e-4866-a914-d6952a73da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d981e1d4-eff1-4435-8b24-a65cbc1c4f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d981e1d4-eff1-4435-8b24-a65cbc1c4f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904274008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba61f54-5448-403c-a57c-d63d5f0b9b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:11Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513356c-ac18-4421-b662-f8651708fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513356c-ac18-4421-b662-f8651708fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd52ee4-fdd6-4363-961e-f06640d9a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd52ee4-fdd6-4363-961e-f06640d9a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba61f54-5448-403c-a57c-d63d5f0b9b9b', 'volume_name': 'volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e6bd15-b97e-4680-a076-b67f5d50d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e6bd15-b97e-4680-a076-b67f5d50d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639701f6-156f-4d8d-8458-8b05f245c034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:10 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Volume fba61f54-5448-403c-a57c-d63d5f0b9b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b', 'volume_size': 1} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904274008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba61f54-5448-403c-a57c-d63d5f0b9b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374e0043c16343fca9cea7c3c617f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:11Z,use_quota=True,user_id='bbea6b5cd6e94ffaa4ed15a2422ee29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Creating volume fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:10 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:10 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b 1073741824 Jul 07 22:57:10 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-98ba233f-b9a7-4150-9602-8ad779da97dd-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-98ba233f-b9a7-4150-9602-8ad779da97dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-98ba233f-b9a7-4150-9602-8ad779da97dd" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-98ba233f-b9a7-4150-9602-8ad779da97dd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 98ba233f-b9a7-4150-9602-8ad779da97dd of volume bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bbe94f-1195-4fe9-96dd-c2e0d57398d1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:11 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd Jul 07 22:57:11 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:11 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b 1073741824" returned: 0 in 0.873s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:11 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b Jul 07 22:57:11 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:12 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd" returned: 0 in 0.799s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb9bc819-2a65-40c8-9d80-62ceb1023585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe542955-4ee8-4960-bae3-02739c9171d6]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:12 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 Jul 07 22:57:12 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:12 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b" returned: 0 in 0.656s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639701f6-156f-4d8d-8458-8b05f245c034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a4aa98-2205-4bf2-a957-1a1441881c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:12 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Volume volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b (fba61f54-5448-403c-a57c-d63d5f0b9b9b): created successfully Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a4aa98-2205-4bf2-a957-1a1441881c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Flow 'volume_create_manager' (fba124fe-921e-4866-a914-d6952a73da56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:12 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-2c457a16-ccaa-4af8-b2d0-bc3c84e80573 tempest-ProjectReaderTests-33891224 None] Created volume successfully. Jul 07 22:57:12 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585" returned: 0 in 0.774s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:12 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:12 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd Jul 07 22:57:12 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Creating offline snapshot 065f4ece-3b6a-450e-91de-d2d0f8c904c1 of volume fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5f93d-9c40-4a4b-a602-225adc8600a8]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:13 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b Jul 07 22:57:13 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:13 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd" returned: 0 in 0.782s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:13 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd Jul 07 22:57:13 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:13 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b" returned: 0 in 0.801s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:13 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:13 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 1G Jul 07 22:57:13 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:14 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585.98ba233f-b9a7-4150-9602-8ad779da97dd" returned: 0 in 0.711s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-98ba233f-b9a7-4150-9602-8ad779da97dd" released by "_delete_snapshot" :: held 3.169s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" released by "delete_snapshot" :: held 3.207s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Created reservations ['9c4d369e-9460-4b14-9f3a-bc9656e32b41', 'd94ab881-53c4-4660-b25e-368bee327a9f', '6ae9154a-584c-4dfd-905a-104633d3aaed', '0e4e3c39-7eed-4508-b9f9-357aa4b494ee'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:14 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-52357772-2aa5-4210-8aa8-36b0ccbbda11 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-98ba233f-b9a7-4150-9602-8ad779da97dd-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:14 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 1G" returned: 0 in 0.869s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:14 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:14 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 Jul 07 22:57:14 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-bb9bc819-2a65-40c8-9d80-62ceb1023585-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-bb9bc819-2a65-40c8-9d80-62ceb1023585-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" acquired by "delete_volume" :: waited 0.053s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:15 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:15 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[778764b1-6be6-406a-b0fb-264baee37bc4]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:15 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1" returned: 0 in 0.920s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:15 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 is being set with open permissions: ugo+rw Jul 07 22:57:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:15 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 Jul 07 22:57:15 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:15 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 Jul 07 22:57:15 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:16 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.829s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:57:16 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585" returned: 0 in 0.826s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:16 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1" returned: 0 in 0.815s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=125,cinder:DELETE=14,cinder:SELECT=113,cinder:INSERT=42 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=99,cinder:INSERT=33,cinder:UPDATE=146,cinder:DELETE=8 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:57:16 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585 Jul 07 22:57:16 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:16 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info Jul 07 22:57:16 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:17 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:17 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info" returned: 0 in 0.708s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-bb9bc819-2a65-40c8-9d80-62ceb1023585" returned: 0 in 0.762s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:17 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info is being set with open permissions: ugo+rw Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:17 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info Jul 07 22:57:17 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-bb9bc819-2a65-40c8-9d80-62ceb1023585" released by "delete_volume" :: held 1.683s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Created reservations ['e2ef7317-ab9f-4993-acbd-59443bd8c000', '880a54eb-0009-4424-bd83-9c8018e6c441', 'b70ba068-2ae1-4e06-93cb-47a6955e725c', '180bd50e-5fdd-45af-b797-be1b66f5ea8b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:17 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:17 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:17 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:18 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.info" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.040s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bd60014f-38cc-447b-83ab-acd3fbfe1b79 tempest-ProjectReaderTests-33891224 None] Create snapshot completed successfully Jul 07 22:57:18 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.899s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:18 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-fd1f18db-132d-4209-b2e9-a02a4ee38097 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-bb9bc819-2a65-40c8-9d80-62ceb1023585-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-065f4ece-3b6a-450e-91de-d2d0f8c904c1-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-065f4ece-3b6a-450e-91de-d2d0f8c904c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (21c52216-89f6-41c8-ac46-21ff92545c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802df7a-fed2-4849-8691-27312872af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802df7a-fed2-4849-8691-27312872af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275614262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6f01a5-1522-4e30-a8c9-4723256ae5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:18Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b6aa47-a95c-46ed-8f0a-b16de2b7b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b6aa47-a95c-46ed-8f0a-b16de2b7b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6ae05-215d-4198-83cc-d6e2add8b88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6ae05-215d-4198-83cc-d6e2add8b88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6f01a5-1522-4e30-a8c9-4723256ae5fc', 'volume_name': 'volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc0742f-036a-4041-a476-1118a35b893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc0742f-036a-4041-a476-1118a35b893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ecb609-2e3e-4a35-8b72-22817b95a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:18 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Volume 5f6f01a5-1522-4e30-a8c9-4723256ae5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc', 'volume_size': 1} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275614262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6f01a5-1522-4e30-a8c9-4723256ae5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:18Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Creating volume 5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:18 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" acquired by "delete_snapshot" :: waited 0.133s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-065f4ece-3b6a-450e-91de-d2d0f8c904c1" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-065f4ece-3b6a-450e-91de-d2d0f8c904c1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:18 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc 1073741824 Jul 07 22:57:18 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Deleting offline snapshot 065f4ece-3b6a-450e-91de-d2d0f8c904c1 of volume fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] snapshot_file for this snap is: volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[39267060-c88a-417b-977b-34e81017ef71]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:18 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:18 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 Jul 07 22:57:18 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:19 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc 1073741824" returned: 0 in 1.036s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:19 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1" returned: 0 in 0.971s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0f2d8-1865-4f49-8c50-7f351eebe4b2]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:19 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:19 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc Jul 07 22:57:19 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:19 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b Jul 07 22:57:19 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:20 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:20 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ecb609-2e3e-4a35-8b72-22817b95a88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559d77c2-862a-4c11-ba79-50b56b610e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b" returned: 0 in 0.840s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:20 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Volume volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc (5f6f01a5-1522-4e30-a8c9-4723256ae5fc): created successfully Jul 07 22:57:20 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 Jul 07 22:57:20 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559d77c2-862a-4c11-ba79-50b56b610e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:20 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (21c52216-89f6-41c8-ac46-21ff92545c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:20 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-be927a4b-0891-488b-aa10-5279d4296aa5 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:57:21 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1" returned: 0 in 0.818s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:21 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1 Jul 07 22:57:21 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 8917cea2-27b4-488b-aab7-0fb81c99ce2d of volume 5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41692f-5b09-4f7a-9dc6-6eab9227fd01]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:21 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:21 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc Jul 07 22:57:21 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:22 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b.065f4ece-3b6a-450e-91de-d2d0f8c904c1" returned: 0 in 0.841s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-065f4ece-3b6a-450e-91de-d2d0f8c904c1" released by "_delete_snapshot" :: held 3.594s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" released by "delete_snapshot" :: held 3.626s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Created reservations ['67eaf0e6-6117-4da4-8648-82b9af5d9083', 'd4b28c79-9a9c-43c1-9dd4-7058ca8e4b56', '109dd290-b57c-4473-a84c-f2e53c4ff64e', '4bd9df30-da3b-4b8d-9d68-f8490f1a88d2'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:22 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Delete snapshot completed successfully. Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-3c5ae480-82e4-4e32-9281-aabb3da4f665 tempest-ProjectReaderTests-33891224 None] Lock "cinder-065f4ece-3b6a-450e-91de-d2d0f8c904c1-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-fba61f54-5448-403c-a57c-d63d5f0b9b9b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "cinder-fba61f54-5448-403c-a57c-d63d5f0b9b9b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Acquiring lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" acquired by "delete_volume" :: waited 0.025s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e5771-f741-4dc4-8a0f-ae19ac9fbcb1]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:22 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" returned: 0 in 1.035s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:22 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:22 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d 1G Jul 07 22:57:22 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:22 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b Jul 07 22:57:22 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:23 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b" returned: 0 in 0.916s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:23 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b Jul 07 22:57:23 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:23 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d 1G" returned: 0 in 1.011s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:23 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:23 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d Jul 07 22:57:23 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:24 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-fba61f54-5448-403c-a57c-d63d5f0b9b9b" returned: 0 in 0.780s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "cinder-quobyte-fba61f54-5448-403c-a57c-d63d5f0b9b9b" released by "delete_volume" :: held 1.781s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Created reservations ['ffc28064-62ca-46c8-a589-38e51f2d5cb2', '30240e13-831a-45fc-8749-a0d994b6f4b7', 'e9fd43ae-5776-45e3-913f-f306a24601d3', '6f4c93c6-6f58-4303-ab65-182f2537c9e5'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:24 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d" returned: 0 in 0.804s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:24 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d is being set with open permissions: ugo+rw Jul 07 22:57:24 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:24 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:24 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:24 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d Jul 07 22:57:24 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:25 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.759s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:25 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:25 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Deleted volume successfully. Jul 07 22:57:25 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-a4c26966-4fd3-4b3d-96ba-d4636fa95de2 tempest-ProjectReaderTests-33891224 None] Lock "cinder-fba61f54-5448-403c-a57c-d63d5f0b9b9b-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:25 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d" returned: 0 in 0.834s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:25 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:25 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info Jul 07 22:57:25 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:26 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info" returned: 0 in 0.854s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:26 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info is being set with open permissions: ugo+rw Jul 07 22:57:26 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:26 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info Jul 07 22:57:26 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:27 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.info" returned: 0 in 0.741s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:27 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.403s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:27 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-a9234116-fe9d-4378-977b-034aaefd050f tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-8917cea2-27b4-488b-aab7-0fb81c99ce2d-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-8917cea2-27b4-488b-aab7-0fb81c99ce2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-8917cea2-27b4-488b-aab7-0fb81c99ce2d" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-8917cea2-27b4-488b-aab7-0fb81c99ce2d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 8917cea2-27b4-488b-aab7-0fb81c99ce2d of volume 5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a1760-3241-4b3f-bbc3-31daf001f534]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:28 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d Jul 07 22:57:28 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:28 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e7f637-1ae2-467b-be49-977d41a3e147]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:28 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:29 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc Jul 07 22:57:29 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:29 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:29 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:29 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d Jul 07 22:57:29 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:30 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d" returned: 0 in 0.788s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:30 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:30 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d Jul 07 22:57:30 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:31 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:31 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc.8917cea2-27b4-488b-aab7-0fb81c99ce2d" returned: 0 in 0.665s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-8917cea2-27b4-488b-aab7-0fb81c99ce2d" released by "_delete_snapshot" :: held 3.130s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" released by "delete_snapshot" :: held 3.158s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:31 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Created reservations ['8f46137f-e90d-490c-bcb1-7b083a1e4175', 'af194041-088f-4c51-b913-af9a9c07eaf6', 'cb7a28d1-51a6-4cdc-a029-2c0028a1fe8e', '73b747d0-220e-4786-b764-50ce142fee2c'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:31 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:57:31 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-cf77faed-9c04-4bf6-b1a0-1383432b60ce tempest-ProjectMemberTests-2095483305 None] Lock "cinder-8917cea2-27b4-488b-aab7-0fb81c99ce2d-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-5f6f01a5-1522-4e30-a8c9-4723256ae5fc-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-5f6f01a5-1522-4e30-a8c9-4723256ae5fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5bef96-1167-49f3-8cb8-fda7d4231978]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:32 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc Jul 07 22:57:32 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:33 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" returned: 0 in 0.840s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:33 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc Jul 07 22:57:33 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:33 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:33 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-5f6f01a5-1522-4e30-a8c9-4723256ae5fc" released by "delete_volume" :: held 1.585s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Created reservations ['0809bbe9-d7f2-4601-9475-6050c7f66a32', '338f2702-3fa7-4ab2-b179-5030e5991762', '3c84245f-88e5-43dc-8eca-c1972a59889c', 'bce19348-b565-44b9-af34-0bacb568b69b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:34 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:34 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:34 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.720s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:57:34 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-4606ced9-4656-428f-8cf9-ffc9c3ffc598 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-5f6f01a5-1522-4e30-a8c9-4723256ae5fc-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (0b91344b-9e36-4734-b706-04370ea333b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7615fc-e7ec-4cea-bbbd-b657afa9ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7615fc-e7ec-4cea-bbbd-b657afa9ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528754056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff344b59-b8e2-4f01-be1b-44496657a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:35Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e398143-c05d-4921-bb80-0760856d1321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e398143-c05d-4921-bb80-0760856d1321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120d73e4-45ae-490e-a294-e8bae274785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120d73e4-45ae-490e-a294-e8bae274785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff344b59-b8e2-4f01-be1b-44496657a02c', 'volume_name': 'volume-ff344b59-b8e2-4f01-be1b-44496657a02c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3bb70f-17ff-4655-9dde-fb584b7e379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3bb70f-17ff-4655-9dde-fb584b7e379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0d4fa0-a579-42e1-8a7b-ea3bd2eb1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:35 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Volume ff344b59-b8e2-4f01-be1b-44496657a02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff344b59-b8e2-4f01-be1b-44496657a02c', 'volume_size': 1} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528754056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff344b59-b8e2-4f01-be1b-44496657a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25b5e01dba14ecb8fa62c5237624189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:35Z,use_quota=True,user_id='bdca8d30a2de4dd7a01f7357ff45f45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Creating volume ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:35 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:35 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c 1073741824 Jul 07 22:57:35 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:35 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c 1073741824" returned: 0 in 0.842s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:36 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c Jul 07 22:57:36 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:36 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c" returned: 0 in 0.642s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0d4fa0-a579-42e1-8a7b-ea3bd2eb1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff344b59-b8e2-4f01-be1b-44496657a02c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e429bf5-5aa7-43ed-9423-8bc55175e204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:36 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Volume volume-ff344b59-b8e2-4f01-be1b-44496657a02c (ff344b59-b8e2-4f01-be1b-44496657a02c): created successfully Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e429bf5-5aa7-43ed-9423-8bc55175e204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:36 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Flow 'volume_create_manager' (0b91344b-9e36-4734-b706-04370ea333b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:36 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-16a387fa-55e8-477e-8d20-920e81fe08b8 tempest-ProjectMemberTests-2095483305 None] Created volume successfully. Jul 07 22:57:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:37 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Creating offline snapshot 0a90d683-8d67-420d-bfd8-3c22bc62b5d6 of volume ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:57:37 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497b85f-5ebf-45ce-b4ea-e0def3098225]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:37 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c Jul 07 22:57:37 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:38 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c" returned: 0 in 0.744s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:38 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 1G Jul 07 22:57:38 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:38 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 1G" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff344b59-b8e2-4f01-be1b-44496657a02c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:38 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff344b59-b8e2-4f01-be1b-44496657a02c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 Jul 07 22:57:38 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:39 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff344b59-b8e2-4f01-be1b-44496657a02c -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6" returned: 0 in 0.660s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:39 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 is being set with open permissions: ugo+rw Jul 07 22:57:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:39 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 Jul 07 22:57:39 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:40 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6" returned: 0 in 0.616s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:40 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info Jul 07 22:57:40 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:40 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info" returned: 0 in 0.651s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:40 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info is being set with open permissions: ugo+rw Jul 07 22:57:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:40 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info Jul 07 22:57:40 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:41 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.info" returned: 0 in 0.658s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:41 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-4be9cb5e-1c25-416b-a9c4-2f8174d2a16d tempest-ProjectMemberTests-2095483305 None] Create snapshot completed successfully Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-0a90d683-8d67-420d-bfd8-3c22bc62b5d6-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-0a90d683-8d67-420d-bfd8-3c22bc62b5d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-0a90d683-8d67-420d-bfd8-3c22bc62b5d6" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-0a90d683-8d67-420d-bfd8-3c22bc62b5d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Deleting offline snapshot 0a90d683-8d67-420d-bfd8-3c22bc62b5d6 of volume ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] snapshot_file for this snap is: volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f045daa-ae93-4558-91ae-beae1e2f9b9b]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:42 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 Jul 07 22:57:42 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:43 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6" returned: 0 in 0.852s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:43 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff344b59-b8e2-4f01-be1b-44496657a02c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:57:43 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd7656d-b7ca-41cd-b8ca-b63796e87229]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:43 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:43 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c Jul 07 22:57:43 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:44 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c" returned: 0 in 0.849s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:44 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:44 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 Jul 07 22:57:44 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:45 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6" returned: 0 in 0.827s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:45 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6 Jul 07 22:57:45 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:45 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:45 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c.0a90d683-8d67-420d-bfd8-3c22bc62b5d6" returned: 0 in 0.687s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-0a90d683-8d67-420d-bfd8-3c22bc62b5d6" released by "_delete_snapshot" :: held 3.318s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" released by "delete_snapshot" :: held 3.341s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Created reservations ['19831fc7-31e0-4532-802e-76c30528c99a', 'a46bdb59-0609-4a35-a0f9-3acbbc289a9d', 'e5db9751-74a0-4164-a277-e9a5a8d66803', 'bc5f2f4d-3068-4201-863f-f728feed8d4d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:46 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Delete snapshot completed successfully. Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-082c0c38-704e-4346-be94-f4788b78d466 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-0a90d683-8d67-420d-bfd8-3c22bc62b5d6-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-ff344b59-b8e2-4f01-be1b-44496657a02c-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-ff344b59-b8e2-4f01-be1b-44496657a02c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:46 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" acquired by "delete_volume" :: waited 0.014s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d0605-de2e-40a9-805a-54fb45fbb735]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:47 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c Jul 07 22:57:47 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:47 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c" returned: 0 in 0.794s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:47 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c Jul 07 22:57:47 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:48 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-ff344b59-b8e2-4f01-be1b-44496657a02c" returned: 0 in 0.686s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-quobyte-ff344b59-b8e2-4f01-be1b-44496657a02c" released by "delete_volume" :: held 1.563s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Created reservations ['33d28bbd-e20f-4c40-a50d-729e781641f4', 'a370701b-3397-4c26-8bcb-d2f83f782d3c', '11bf1916-f4b9-47be-adb4-132428758e81', '0168b32f-bc29-4877-9ec7-6af53b6dd494'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:48 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:48 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:49 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.718s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:49 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:49 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Deleted volume successfully. Jul 07 22:57:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-5f4d2da8-4b2d-46fa-bc9e-f956a6f21fe4 tempest-ProjectMemberTests-2095483305 None] Lock "cinder-ff344b59-b8e2-4f01-be1b-44496657a02c-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (54f991ab-af88-4617-81b6-d8b4257e2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2dccce-e35e-4e12-abb0-c740f0325875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2dccce-e35e-4e12-abb0-c740f0325875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428750298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:53Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f22204-ea90-47dc-9552-2c3e9c81da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f22204-ea90-47dc-9552-2c3e9c81da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e352c-60f4-4aaf-a5ba-af00bc3a76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e352c-60f4-4aaf-a5ba-af00bc3a76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e', 'volume_name': 'volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84c7476-d943-49db-b059-08d67c2d483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84c7476-d943-49db-b059-08d67c2d483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348c99e5-0a24-4cba-a0c6-22ef54a6639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:52 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Volume 0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e', 'volume_size': 1} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428750298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:53Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Creating volume 0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:52 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:53 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:53 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e 1073741824 Jul 07 22:57:53 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:53 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e 1073741824" returned: 0 in 0.835s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:53 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e Jul 07 22:57:53 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:54 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" returned: 0 in 0.642s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348c99e5-0a24-4cba-a0c6-22ef54a6639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d46ef4-717e-4c24-9388-f57caf30c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:54 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Volume volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e (0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e): created successfully Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d46ef4-717e-4c24-9388-f57caf30c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:54 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (54f991ab-af88-4617-81b6-d8b4257e2946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:54 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-31fd3250-bf9e-4038-876f-b15b8dce8002 tempest-ProjectReaderTests-1540710764 None] Created volume successfully. Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-quobyte-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5453c0-edbc-4153-ac39-e42c8a2765f5]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:57:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:55 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e Jul 07 22:57:55 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:56 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" returned: 0 in 0.811s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:56 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e Jul 07 22:57:56 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:56 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" returned: 0 in 0.666s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e" released by "delete_volume" :: held 1.518s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Created reservations ['6c1469bc-638e-42f8-a860-afc4e759ada7', '3b64e2a9-e23d-44aa-b5d3-b7cf27b585b1', 'd39053ce-595f-41e2-a3f6-326b543e7ab7', '56cfeea4-9dd4-48c6-b652-ef2c2266ccf0'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:56 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:57:56 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:57 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.690s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:57:57 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Deleted volume successfully. Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-be39c988-8767-4dd2-adc7-a29c18082cb9 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-0a5915ae-31fb-4bec-a6a7-7f0d4da9bd8e-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (be8fde2e-0873-4c10-839b-49a7834976e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360add3e-46b2-4e26-9285-5d5eafd5a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360add3e-46b2-4e26-9285-5d5eafd5a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494100944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2636d843-5114-429a-8a75-067ee940039c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:58Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edaf4dd-6716-481a-a56e-13ede7f63f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edaf4dd-6716-481a-a56e-13ede7f63f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d2f210-cefa-4a16-9ff8-0cd24e0cc1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d2f210-cefa-4a16-9ff8-0cd24e0cc1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2636d843-5114-429a-8a75-067ee940039c', 'volume_name': 'volume-2636d843-5114-429a-8a75-067ee940039c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5368fd80-14dd-4cfe-91bb-0d20bdb78643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5368fd80-14dd-4cfe-91bb-0d20bdb78643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ea59d1-df36-4010-8e04-2699c1cfe8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:57 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Volume 2636d843-5114-429a-8a75-067ee940039c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2636d843-5114-429a-8a75-067ee940039c', 'volume_size': 1} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494100944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2636d843-5114-429a-8a75-067ee940039c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:58Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Creating volume 2636d843-5114-429a-8a75-067ee940039c {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:57:57 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:57:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:57 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c 1073741824 Jul 07 22:57:57 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:58 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c 1073741824" returned: 0 in 0.883s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:57:58 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c Jul 07 22:57:58 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:57:59 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c" returned: 0 in 0.658s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ea59d1-df36-4010-8e04-2699c1cfe8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2636d843-5114-429a-8a75-067ee940039c', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262976c7-f55f-400c-ab16-0dfb44e3690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:57:59 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Volume volume-2636d843-5114-429a-8a75-067ee940039c (2636d843-5114-429a-8a75-067ee940039c): created successfully Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262976c7-f55f-400c-ab16-0dfb44e3690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:57:59 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (be8fde2e-0873-4c10-839b-49a7834976e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:57:59 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-dd3103ca-500e-4213-99c1-720e355f30e6 tempest-ProjectReaderTests-1540710764 None] Created volume successfully. Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-2636d843-5114-429a-8a75-067ee940039c-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-2636d843-5114-429a-8a75-067ee940039c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-quobyte-2636d843-5114-429a-8a75-067ee940039c" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-2636d843-5114-429a-8a75-067ee940039c" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c89869-5f36-4569-a624-40d953eb0cc3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:00 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c Jul 07 22:58:00 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:00 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c" returned: 0 in 0.793s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:00 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:00 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c Jul 07 22:58:00 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:01 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-2636d843-5114-429a-8a75-067ee940039c" returned: 0 in 0.652s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-2636d843-5114-429a-8a75-067ee940039c" released by "delete_volume" :: held 1.482s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Created reservations ['54d308da-9ab0-4a37-936a-069ac498304f', 'c559a136-03a5-4bfe-abd1-de57aad9218d', '257c0f8a-81cd-4b56-b2d5-017b5f5bb6d3', '4a4384ef-50a3-405d-b80b-f6fec7d10ceb'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:01 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:01 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:01 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:02 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.663s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:02 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Deleted volume successfully. Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-91b77213-0b3a-4c20-8e03-a488228aca70 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-2636d843-5114-429a-8a75-067ee940039c-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (d76c8630-0f65-42c4-8410-98057c381474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f61801-0017-484c-8d2c-997ba3c339a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f61801-0017-484c-8d2c-997ba3c339a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182786109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159df752-d214-4cbd-b440-cbc7fcb99617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:03Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce07c90d-7155-45a1-b386-1212b2657e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce07c90d-7155-45a1-b386-1212b2657e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ae943-d89e-4fe9-985f-b84a2a897795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ae943-d89e-4fe9-985f-b84a2a897795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159df752-d214-4cbd-b440-cbc7fcb99617', 'volume_name': 'volume-159df752-d214-4cbd-b440-cbc7fcb99617', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9aa618-cb18-4c9c-a821-91f79450f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9aa618-cb18-4c9c-a821-91f79450f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa855b7-7ab6-44cd-b0ac-7772454cc13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:02 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Volume 159df752-d214-4cbd-b440-cbc7fcb99617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159df752-d214-4cbd-b440-cbc7fcb99617', 'volume_size': 1} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182786109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159df752-d214-4cbd-b440-cbc7fcb99617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:03Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Creating volume 159df752-d214-4cbd-b440-cbc7fcb99617 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:58:02 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:58:02 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:02 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 1073741824 Jul 07 22:58:02 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:03 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 1073741824" returned: 0 in 0.861s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:03 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:03 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 Jul 07 22:58:03 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:04 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617" returned: 0 in 0.680s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa855b7-7ab6-44cd-b0ac-7772454cc13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159df752-d214-4cbd-b440-cbc7fcb99617', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc5b807-6d86-4230-a439-c4d89334a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:04 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Volume volume-159df752-d214-4cbd-b440-cbc7fcb99617 (159df752-d214-4cbd-b440-cbc7fcb99617): created successfully Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc5b807-6d86-4230-a439-c4d89334a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (d76c8630-0f65-42c4-8410-98057c381474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:04 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-9587d6d2-48fb-4397-a111-cb2c09f4f857 tempest-ProjectReaderTests-1540710764 None] Created volume successfully. Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-159df752-d214-4cbd-b440-cbc7fcb99617-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-159df752-d214-4cbd-b440-cbc7fcb99617-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-quobyte-159df752-d214-4cbd-b440-cbc7fcb99617" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-159df752-d214-4cbd-b440-cbc7fcb99617" acquired by "delete_volume" :: waited 0.020s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7689ec-9793-4ec2-8c1c-8b63666feebe]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:04 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:05 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 Jul 07 22:58:05 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:05 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617" returned: 0 in 0.795s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:05 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:05 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617 Jul 07 22:58:05 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:06 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-159df752-d214-4cbd-b440-cbc7fcb99617" returned: 0 in 0.702s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-159df752-d214-4cbd-b440-cbc7fcb99617" released by "delete_volume" :: held 1.534s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Created reservations ['d4bcb9cd-e48c-473b-a577-35bd0f7f8b73', '88ee46a6-c0fe-4219-84cb-3c6a8093b28f', 'e1cc80ea-9f51-4135-bfb2-57e8429f8e16', '1f90338d-663d-451a-88bf-984686b6767b'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:06 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:06 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:06 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:07 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.690s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:07 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Deleted volume successfully. Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-211c6e65-9c9a-451c-ba8e-aa66ccb60554 tempest-ProjectReaderTests-1540710764 None] Lock "cinder-159df752-d214-4cbd-b440-cbc7fcb99617-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (208c6391-0036-4b97-a06e-eedc39537434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba695fc-9dae-4d66-8dc0-3acef9140fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba695fc-9dae-4d66-8dc0-3acef9140fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167133269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023e985a-713f-4cd9-8073-9387fd08b378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:08Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ad8ec2-914f-4f9c-b46a-3d7a2e5f2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ad8ec2-914f-4f9c-b46a-3d7a2e5f2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57edadca-c733-44ed-9437-a1d8863cda4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57edadca-c733-44ed-9437-a1d8863cda4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023e985a-713f-4cd9-8073-9387fd08b378', 'volume_name': 'volume-023e985a-713f-4cd9-8073-9387fd08b378', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd7257-69d0-4d94-a940-b99af7170a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fd7257-69d0-4d94-a940-b99af7170a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b9705-87c6-4259-92d4-c7bd2ad5a08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:07 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Volume 023e985a-713f-4cd9-8073-9387fd08b378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023e985a-713f-4cd9-8073-9387fd08b378', 'volume_size': 1} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167133269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023e985a-713f-4cd9-8073-9387fd08b378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf3bfff247948d8bbe2e414813e52f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:08Z,use_quota=True,user_id='b55a2838d84049a88229763cbdab08c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Creating volume 023e985a-713f-4cd9-8073-9387fd08b378 {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:58:07 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:58:07 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:07 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 1073741824 Jul 07 22:58:07 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:08 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 1073741824" returned: 0 in 0.845s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:08 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:08 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 Jul 07 22:58:08 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:09 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378" returned: 0 in 0.632s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b9705-87c6-4259-92d4-c7bd2ad5a08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023e985a-713f-4cd9-8073-9387fd08b378', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca572b67-0c7d-4acf-87e2-59400bf38c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:09 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Volume volume-023e985a-713f-4cd9-8073-9387fd08b378 (023e985a-713f-4cd9-8073-9387fd08b378): created successfully Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca572b67-0c7d-4acf-87e2-59400bf38c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Flow 'volume_create_manager' (208c6391-0036-4b97-a06e-eedc39537434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:09 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e21521d9-eb1f-4173-9cf6-57742639d823 tempest-ProjectReaderTests-1540710764 None] Created volume successfully. Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-023e985a-713f-4cd9-8073-9387fd08b378-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "cinder-023e985a-713f-4cd9-8073-9387fd08b378-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Acquiring lock "cinder-quobyte-023e985a-713f-4cd9-8073-9387fd08b378" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-023e985a-713f-4cd9-8073-9387fd08b378" acquired by "delete_volume" :: waited 0.016s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47c7af4-06e5-412b-b118-16e86c47e8d0]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:09 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:09 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 Jul 07 22:58:09 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:10 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378" returned: 0 in 0.750s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:10 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:10 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378 Jul 07 22:58:10 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:11 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-023e985a-713f-4cd9-8073-9387fd08b378" returned: 0 in 0.649s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "cinder-quobyte-023e985a-713f-4cd9-8073-9387fd08b378" released by "delete_volume" :: held 1.439s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Created reservations ['663714b0-2a88-4ddb-b767-1c9d6cbe8cd4', '835bc04b-179a-4ddf-b198-fb2ddcae0c7a', '3551e5d4-3ed6-4611-9a25-cfb310414fdb', '44d56663-4ede-402d-a1af-bda453e9a299'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:11 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:11 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:11 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:11 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:11 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Deleted volume successfully. Jul 07 22:58:12 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-bbfbaba0-2846-4bb1-b69c-3f28aabbbd0d tempest-ProjectReaderTests-1540710764 None] Lock "cinder-023e985a-713f-4cd9-8073-9387fd08b378-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:15 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:15 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:16 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.704s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:58:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:58:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:58:21 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:58:21 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=69,cinder:INSERT=27,cinder:UPDATE=105,cinder:DELETE=9 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Flow 'volume_create_manager' (124dcb31-a53e-47ea-bc00-9f07b406165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e767c989-db78-485a-adb8-fde3d7bdb2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e767c989-db78-485a-adb8-fde3d7bdb2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-910816747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3381b2c-f7f1-4e2e-99ca-341af54381fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03ca1e61185d456fbdec79a80520985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:32Z,use_quota=True,user_id='8d6a742766d848d9b7e4f7c90f71307d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b1b4dd-e32d-4012-8e3b-f547beca85ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b1b4dd-e32d-4012-8e3b-f547beca85ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b0875a-18e0-4b61-b3a8-b4acaaaeebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b0875a-18e0-4b61-b3a8-b4acaaaeebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3381b2c-f7f1-4e2e-99ca-341af54381fb', 'volume_name': 'volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39df6350-01df-4cbb-8ce1-2ad5fc45b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39df6350-01df-4cbb-8ce1-2ad5fc45b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed33517-eefb-4ca9-bb23-02f322f184b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:32 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Volume b3381b2c-f7f1-4e2e-99ca-341af54381fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb', 'volume_size': 1} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-910816747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3381b2c-f7f1-4e2e-99ca-341af54381fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03ca1e61185d456fbdec79a80520985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:32Z,use_quota=True,user_id='8d6a742766d848d9b7e4f7c90f71307d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)}" {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Creating volume b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:58:32 devstack cinder-volume[88087]: INFO cinder.volume.drivers.remotefs [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] casted to osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c Jul 07 22:58:32 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb 1073741824 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:32 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb 1073741824 Jul 07 22:58:32 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:33 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb 1073741824" returned: 0 in 0.810s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:33 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:33 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:33 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:34 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.625s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'} {{(pid=88087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed33517-eefb-4ca9-bb23-02f322f184b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb', 'volume_size': 1}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446d6bc3-4a2b-4e8d-a00e-90d735248223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:34 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Volume volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb (b3381b2c-f7f1-4e2e-99ca-341af54381fb): created successfully Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446d6bc3-4a2b-4e8d-a00e-90d735248223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Flow 'volume_create_manager' (124dcb31-a53e-47ea-bc00-9f07b406165a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:34 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-e7011d8b-b356-4845-800e-d86d74c19b1c tempest-SnapshotDependencyTests-575956743 None] Created volume successfully. Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Creating offline snapshot c432c0ef-9d38-472f-84d1-753144a3a299 of volume b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde82bdd-5ba5-49b8-8311-e783eb9c4953]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:34 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:34 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:34 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:35 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.743s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:35 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 1G {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:35 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 1G Jul 07 22:58:35 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:36 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 1G" returned: 0 in 0.805s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:36 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:36 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:36 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:37 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb -F qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.768s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:37 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 is being set with open permissions: ugo+rw Jul 07 22:58:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:37 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:37 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:37 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.658s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:37 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:37 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info Jul 07 22:58:37 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:38 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info" returned: 0 in 0.674s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:38 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info is being set with open permissions: ugo+rw Jul 07 22:58:38 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:38 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info Jul 07 22:58:38 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:39 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.info" returned: 0 in 0.640s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:39 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:39 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-61fd2322-2180-4ec5-8b0a-4f78fe17a7bc tempest-SnapshotDependencyTests-575956743 None] Create snapshot completed successfully Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Flow 'volume_create_manager' (221d778d-e603-4b40-af97-ffb38f4bfd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e027d0-25fc-4b29-a652-f4283bc2ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e027d0-25fc-4b29-a652-f4283bc2ba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c11875-3a8e-4409-8c9c-a9af3a97ff0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03ca1e61185d456fbdec79a80520985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c432c0ef-9d38-472f-84d1-753144a3a299,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:41Z,use_quota=True,user_id='8d6a742766d848d9b7e4f7c90f71307d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626bec66-184b-4d11-a269-5da689da3ed2),volume_type_id=626bec66-184b-4d11-a269-5da689da3ed2)' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950eae83-f35c-43bc-8f57-c0d2449247c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950eae83-f35c-43bc-8f57-c0d2449247c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee45c32-b629-4f3e-819a-58807d90cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee45c32-b629-4f3e-819a-58807d90cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9c11875-3a8e-4409-8c9c-a9af3a97ff0b', 'volume_name': 'volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b', 'volume_size': 1, 'snapshot_id': 'c432c0ef-9d38-472f-84d1-753144a3a299'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37bc18c-aedc-496e-ae29-99ebd57998c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37bc18c-aedc-496e-ae29-99ebd57998c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcabd8ce-68fb-44ae-9a48-212ff5036152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:40 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Volume c9c11875-3a8e-4409-8c9c-a9af3a97ff0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b', 'volume_size': 1, 'snapshot_id': 'c432c0ef-9d38-472f-84d1-753144a3a299'} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" by "_create_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Creating volume c9c11875-3a8e-4409-8c9c-a9af3a97ff0b from snapshot c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Selected osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c as target Quobyte volume. {{(pid=88087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" by "_copy_volume_from_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] snapshot: c432c0ef-9d38-472f-84d1-753144a3a299, volume: c9c11875-3a8e-4409-8c9c-a9af3a97ff0b, {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[82774250-8dc3-4799-ae6b-7030771ef060]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:40 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:40 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:40 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:41 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.847s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Creating direct copy from snapshot {{(pid=88087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f56ef55-1f85-480d-b945-6fd39848ec0d]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:41 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:41 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:41 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:42 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.778s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:42 devstack cinder-volume[88087]: DEBUG cinder.utils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Path /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b not found in is_blk_device check {{(pid=88087) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:58:42 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:42 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b Jul 07 22:58:42 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:47 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" returned: 0 in 4.688s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:47 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[962bc70b-f10e-46c1-850e-261fba7d2a87]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:47 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:47 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:47 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:48 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.966s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.image.image_utils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Image conversion details: src /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b {{(pid=88087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:58:48 devstack cinder-volume[88087]: INFO cinder.image.image_utils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Converted 1024.00 MB image at 218.35 MB/s Jul 07 22:58:48 devstack cinder-volume[88087]: WARNING cinder.volume.drivers.remotefs [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b is being set with open permissions: ugo+rw Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:48 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b Jul 07 22:58:48 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:48 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" returned: 0 in 0.734s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" released by "_copy_volume_from_snapshot" :: held 8.112s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" released by "_create_volume_from_snapshot" :: held 8.144s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.160s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcabd8ce-68fb-44ae-9a48-212ff5036152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b', 'volume_size': 1, 'snapshot_id': 'c432c0ef-9d38-472f-84d1-753144a3a299'}' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f18806f-052d-4f8e-ba21-091a0c2e5f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:58:48 devstack cinder-volume[88087]: INFO cinder.volume.flows.manager.create_volume [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Volume volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b (c9c11875-3a8e-4409-8c9c-a9af3a97ff0b): created successfully Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f18806f-052d-4f8e-ba21-091a0c2e5f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:58:48 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Flow 'volume_create_manager' (221d778d-e603-4b40-af97-ffb38f4bfd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:58:48 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-49ab8967-ff4c-4d68-be3f-9dfc55d11d15 tempest-SnapshotDependencyTests-575956743 None] Created volume successfully. Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-c432c0ef-9d38-472f-84d1-753144a3a299-delete_snapshot" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-c432c0ef-9d38-472f-84d1-753144a3a299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" by "delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299" by "_delete_snapshot" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Deleting offline snapshot c432c0ef-9d38-472f-84d1-753144a3a299 of volume b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] snapshot_file for this snap is: volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe17ad-703b-4019-b90d-3c88b2fbbd65]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:49 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:49 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:49 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:50 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.735s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.remotefs [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5dc2b-f419-407c-a032-2bf8863caff7]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:50 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:50 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:50 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.730s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:50 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:50 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:50 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:51 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.743s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:51 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:51 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299 Jul 07 22:58:51 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:52 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:52 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb.c432c0ef-9d38-472f-84d1-753144a3a299" returned: 0 in 0.656s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c432c0ef-9d38-472f-84d1-753144a3a299" released by "_delete_snapshot" :: held 2.975s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" released by "delete_snapshot" :: held 2.996s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:52 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Created reservations ['6b438e41-e04a-4749-a186-a3ce3bbc61ae', '8e47e268-1b70-452a-8411-a6a76eda1dcf', '8f56e166-2bf5-4425-b6ac-63bf081f3d2d', '8af50abf-8ace-443b-9bd8-de7e40326748'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:52 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Delete snapshot completed successfully. Jul 07 22:58:52 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-1d8913b4-5dd2-482f-9c21-221aec2c3fad tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-c432c0ef-9d38-472f-84d1-753144a3a299-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-b3381b2c-f7f1-4e2e-99ca-341af54381fb-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-b3381b2c-f7f1-4e2e-99ca-341af54381fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0b201b-3eb0-4929-9a52-6ba6878822d3]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:53 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:53 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:53 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:54 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.740s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:54 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:54 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb Jul 07 22:58:54 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:55 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-b3381b2c-f7f1-4e2e-99ca-341af54381fb" returned: 0 in 0.785s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-b3381b2c-f7f1-4e2e-99ca-341af54381fb" released by "delete_volume" :: held 1.630s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Created reservations ['292ff4d6-d067-40ec-88a8-17d3d8df5fe4', 'b3782607-5480-4e15-adfc-0da641e5818d', '44405e69-3fcb-46a7-b1b1-68a48a9c0a6a', '8f4299b5-98f7-4514-afd1-ea8d1a286b1d'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:55 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:55 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b-delete_volume" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:55 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" by "delete_volume" {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" acquired by "delete_volume" :: waited 0.018s {{(pid=88087) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG oslo.privsep.daemon [-] privsep: reply[38650eb0-f7f3-4038-8e23-05ccc7ccf072]: (4, 'qcow2') {{(pid=89307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:56 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.672s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:56 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Deleted volume successfully. Jul 07 22:58:56 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b Jul 07 22:58:56 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:56 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-7bab59c9-1225-490a-b54e-cd3dc9589bde tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-b3381b2c-f7f1-4e2e-99ca-341af54381fb-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:57 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" returned: 0 in 0.972s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:57 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b Jul 07 22:58:57 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:57 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24/volume-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" returned: 0 in 0.698s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-quobyte-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b" released by "delete_volume" :: held 1.720s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG cinder.quota [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Created reservations ['ed6fd283-314f-4f68-a9e0-707c99892fc1', '18cac306-6f8c-4cc9-8c96-8191d2783810', '48736491-eb42-4578-8462-77b8ca1fb953', '67d81000-eb75-4ca6-bf6f-1c50567630dd'] {{(pid=88087) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:58:57 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:58:57 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:58:57 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:58:58 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jul 07 22:58:58 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.713s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:58:58 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:58:58 devstack cinder-volume[88087]: INFO cinder.volume.manager [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Deleted volume successfully. Jul 07 22:58:58 devstack cinder-volume[88087]: DEBUG cinder.coordination [None req-f1a776f1-ff4f-48ef-b40e-5785cdb30051 tempest-SnapshotDependencyTests-575956743 None] Lock "cinder-c9c11875-3a8e-4409-8c9c-a9af3a97ff0b-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=88087) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:59:07 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:SELECT=27,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:59:08 devstack cinder-volume[88087]: DEBUG dbcounter [-] [88087] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=8 {{(pid=88087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c': None} {{(pid=88087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG cinder.volume.drivers.quobyte [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-40216831-daa0-4f13-b378-f7c5fe734e1c'] {{(pid=88087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.lockutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:59:15 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:59:15 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24 Jul 07 22:59:15 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:59:16 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Jul 07 22:59:16 devstack cinder-volume[88087]: DEBUG oslo_concurrency.processutils [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/02761d7ddaa36fe280b25c5a6a7e3b24" returned: 0 in 0.678s {{(pid=88087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:59:16 devstack cinder-volume[88087]: DEBUG cinder.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Notifying Schedulers of capabilities ... {{(pid=88087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:59:16 devstack cinder-volume[88087]: DEBUG oslo_service.periodic_task [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] Running periodic task VolumeManager._thread_info {{(pid=88087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:59:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread count: 28 {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:59:16 devstack cinder-volume[88087]: DEBUG cinder.volume.manager [None req-ccf8045d-105d-4140-9a5f-6e01aacbdd56 None None] thread info: [<_MainThread(MainThread, started 132068141600896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}